2026-09-01T00:37:56,715 Created temporary directory: /tmp/pip-ephem-wheel-cache-gj4e4ptt 2026-09-01T00:37:56,717 Created temporary directory: /tmp/pip-build-tracker-af640hge 2026-09-01T00:37:56,718 Initialized build tracking at /tmp/pip-build-tracker-af640hge 2026-09-01T00:37:56,718 Created build tracker: /tmp/pip-build-tracker-af640hge 2026-09-01T00:37:56,719 Entered build tracker: /tmp/pip-build-tracker-af640hge 2026-09-01T00:37:56,720 Created temporary directory: /tmp/pip-wheel-7j_poii0 2026-09-01T00:37:56,723 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-09-01T00:37:56,725 Created temporary directory: /tmp/pip-ephem-wheel-cache-0ujak8fh 2026-09-01T00:37:56,751 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-09-01T00:37:56,754 2 location(s) to search for versions of lm-eval: 2026-09-01T00:37:56,754 * https://pypi.org/simple/lm-eval/ 2026-09-01T00:37:56,754 * https://www.piwheels.org/simple/lm-eval/ 2026-09-01T00:37:56,755 Fetching project page and analyzing links: https://pypi.org/simple/lm-eval/ 2026-09-01T00:37:56,756 Getting page https://pypi.org/simple/lm-eval/ 2026-09-01T00:37:56,757 Found index url https://pypi.org/simple 2026-09-01T00:37:56,914 Fetched page https://pypi.org/simple/lm-eval/ as application/vnd.pypi.simple.v1+json 2026-09-01T00:37:56,922 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/1b/5f/7841febb99c12ffb453d33a67b9841e89dba18c388b644bf22b81d137fc4/lm_eval-0.0.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:37:56,923 Found link https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.0.1 2026-09-01T00:37:56,924 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f3/a7/63cbce8b51de25fabb1c49f3a3fd1704faaacadb5ed816401f800e4d2dbd/lm_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:37:56,925 Found link https://files.pythonhosted.org/packages/c5/fd/edd21b0f258b4ec0260f99f5b2ac3864f7cddc8fb7c83bbb2379a6aab975/lm_eval-0.2.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.2.0 2026-09-01T00:37:56,926 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/61/c5/bff92e6b61fc2b0c1b7ac769633731910152e5176a404912ce7c07329ba0/lm_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:37:56,927 Found link https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.3.0 2026-09-01T00:37:56,928 Found link https://files.pythonhosted.org/packages/45/e0/05001c2e56e2f8f793189442176432ddb89a2f1f1ef00ea154d0bc00fe37/lm_eval-0.4.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.0 2026-09-01T00:37:56,929 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/49/2d/39f7a25ab663cb45cfc7773b85980f01df44853cc427d00dce94c90b43e6/lm_eval-0.4.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:56,929 Found link https://files.pythonhosted.org/packages/5a/02/1c7f1ac2f139f4c05af5b94e2c4f88a70404fa0b0c22a5fb04dec0216b03/lm_eval-0.4.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.1 2026-09-01T00:37:56,930 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/0c/5a/64cf703b62ac7ada09a514c16c7136bb4ea7ef3030eb4c3d780900a5a634/lm_eval-0.4.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:56,931 Found link https://files.pythonhosted.org/packages/75/ca/18814743ba3b42d19d8524a4f771e9c3a7aa02cd4c579747a0f513907205/lm_eval-0.4.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.2 2026-09-01T00:37:56,932 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/39/2b/eb15fb57ba48b3cebfd302713d680d9917101867e2b5fbfd266e88b89ff3/lm_eval-0.4.3-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:56,933 Found link https://files.pythonhosted.org/packages/2e/69/dbff28f17e17521735460b25645479e85b58d8ad7ea8488e4672ab52b58b/lm_eval-0.4.3.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.3 2026-09-01T00:37:56,934 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/ad/e1/ac8d7d26b4d6a9eea8859d438691b5d8209a37be2117b3e61f247de2d9e7/lm_eval-0.4.4-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:56,935 Found link https://files.pythonhosted.org/packages/c6/a8/4dcffd9ad0ddb6c479f93d8316a108a6f9b4d81756c892f150b6c307e8d4/lm_eval-0.4.4.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.4 2026-09-01T00:37:56,935 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c1/78/fb3ea82c77ccc4dbbd6cafceb15ca01c1cd4d778217d572d65c919b0643f/lm_eval-0.4.5-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:56,936 Found link https://files.pythonhosted.org/packages/68/7a/cb1993a8d217a5b4c6e52f612a677c4f02c3412d2e3093ecbf6f6413136c/lm_eval-0.4.5.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.5 2026-09-01T00:37:56,937 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/45/b9/1b4e3268b590d9ff16e087685d9526455bb677c3e4d0caeba4451f20c586/lm_eval-0.4.7-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:56,938 Found link https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.7 2026-09-01T00:37:56,938 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c3/0b/36d6117f644f3685e6b87005ecd7051d01e9cdcf617e8e671102c1546de2/lm_eval-0.4.8-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:37:56,939 Found link https://files.pythonhosted.org/packages/ba/b2/fe23d318c5f645636f9f776c373d1ba68aa55c998894660613a09b0fe2ec/lm_eval-0.4.8.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.8 2026-09-01T00:37:56,940 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/b6/4f/3ab58de3dfee26f693d149824d9d62723f771392c4756becccbcbaaa4e03/lm_eval-0.4.9-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:37:56,941 Found link https://files.pythonhosted.org/packages/e5/ab/866d8957cddbb26510e5cf5f7c5ec01e179f82d54d2dafd3a6c5c31fc200/lm_eval-0.4.9.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9 2026-09-01T00:37:56,942 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/18/ba/3a992d435deaf5461f50417bd7ba38a21831a04520941a9ecf1020dcf900/lm_eval-0.4.9.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:37:56,943 Found link https://files.pythonhosted.org/packages/b9/81/943efd4d008080625ddb135d961fc40e78fa75c61f4ce1b4b1244c667571/lm_eval-0.4.9.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9.1 2026-09-01T00:37:56,943 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/6c/50/3903694e69c94ae8dcec654843cb99799e45137e0d1a0a581009aa592673/lm_eval-0.4.9.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:56,945 Found link https://files.pythonhosted.org/packages/e1/5e/e6d70f4aa2acd7932a873c51de93ddf2dbd1c43aa6f6c86314ab3c0d279d/lm_eval-0.4.9.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.9.2 2026-09-01T00:37:56,945 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/23/5b/d0762a01f140e945aa7a44c92bb0c5c149c2c2917278c02eef6f5053b8e1/lm_eval-0.4.10-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:56,946 Found link https://files.pythonhosted.org/packages/7c/1c/858cc03ac7960bc7a1323d40a0d912ebef560825075504238f6721ad8a3a/lm_eval-0.4.10.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.10 2026-09-01T00:37:56,947 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/df/b3/8c2923ad4c4d911307e20ab9c7d7869d3811b5a76fe6dbe53678aafbeb04/lm_eval-0.4.11-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:56,947 Found link https://files.pythonhosted.org/packages/18/40/ad60ae17f97902ba4ee67914a94c159552f8643fb4598d1d2430a571f0a2/lm_eval-0.4.11.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.11 2026-09-01T00:37:56,948 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/bd/43/944724465ed73ec2889f58007c114ce8dd2023324bc86d3e6f41ce00e2e8/lm_eval-0.4.12-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:56,949 Found link https://files.pythonhosted.org/packages/12/32/783623b1d1fe7c89ebd774db46bef4c787fe93e7c5e1b4877c7dfbf1abbe/lm_eval-0.4.12.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.12 2026-09-01T00:37:56,949 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/03/da/b9a60f1d746cf1d79c0abc414409e149cea611532bab70811775d581be1e/lm_eval-0.4.13.dev0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:56,950 Found link https://files.pythonhosted.org/packages/6d/6d/e8bae20c63575c7d8939ebb0e6f22b9dc287f42a9d0f0a39523a186121ca/lm_eval-0.4.13.dev0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.13.dev0 2026-09-01T00:37:56,951 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/7d/e8/e90272ef920d5a77c91bf0473e325113950f37bfeaca2fa3b98e16142961/lm_eval-0.4.13-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:56,952 Found link https://files.pythonhosted.org/packages/89/b1/cfcdf2a8c8b8e755ec7103a7d4b6f8673f7916641ca08df83412c531935b/lm_eval-0.4.13.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.13 2026-09-01T00:37:56,953 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f4/dc/8dc6e399a1e97948064a571639ad5b3f2b7cae84f930dae081e49bcafd47/lm_eval-0.5.0.dev1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:56,954 Found link https://files.pythonhosted.org/packages/65/41/26141271560b0a41e2279fe2a2f29bf75e26cfb93849e3d5ad68c28ba66b/lm_eval-0.5.0.dev1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.5.0.dev1 2026-09-01T00:37:56,955 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-eval/ 2026-09-01T00:37:56,956 Getting page https://www.piwheels.org/simple/lm-eval/ 2026-09-01T00:37:56,957 Found index url https://www.piwheels.org/simple 2026-09-01T00:37:57,263 Fetched page https://www.piwheels.org/simple/lm-eval/ as text/html 2026-09-01T00:37:57,270 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.5.0.dev1-py3-none-any.whl#sha256=2b123742db0404ed529819f64cdd873004c66e5d8ad3d552a5e5c5f7f216d246 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:57,271 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.13.dev0-py3-none-any.whl#sha256=8e343cfaee8e4c15c7887120bf59466f130caa94b33960ecb859e529bfc298aa (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:57,272 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.12-py3-none-any.whl#sha256=fcb805fe553443c0365cbb87826c85649f35c9f7d40fb07e0272f8629b90cb01 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:57,272 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.11-py3-none-any.whl#sha256=7a994cec7f884dff2892c895be7943f2e5daf899d1a0c96862a09e86d38317ef (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:57,272 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.10-py3-none-any.whl#sha256=f974c8439950d7e007710fae43c1ff085ba2724b8c9c29456987c442a14ddc4a (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:57,273 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9.2-py3-none-any.whl#sha256=6433acae848f5040a05aec1f8b4d946c1874207195592064a0dccbf11e6a3bf7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:37:57,274 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9.1-py3-none-any.whl#sha256=97ecff896cf8c8a3461730701532cb297638f594631d30e0a0e64bedacc771ce (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:37:57,274 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9-py3-none-any.whl#sha256=aae7521fd8819d6dd3ae674c07816f449a70669bef1db6cdce2968c21ad1f7af (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:37:57,275 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.8-py3-none-any.whl#sha256=1ed005366d8f0154fa200db6e0eb56cc5ef33df2bbd2705d19c742e4283593c8 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:37:57,275 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.7-py3-none-any.whl#sha256=3b462a73021c5411e6b4491d07d5c4c009843435a2c9350ae5949fbf4a196ed9 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:57,276 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.5-py3-none-any.whl#sha256=c1292031153f79a22db4193ed91074a1c57ffaec3d9768215a455efd53ff5f02 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:57,277 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.4-py3-none-any.whl#sha256=1a6e6b514b470ad4c795439aa4cf9cb88b1360d915c7b3108ae5b47e3f7b36fc (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:57,277 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.3-py3-none-any.whl#sha256=7f4cb7cbd7ea20f2624f1315e69dfbc884cc187749c85760f9b4ec03e7efe491 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:57,278 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.2-py3-none-any.whl#sha256=a0bcaff492a09947d8a2b80400f224113b1e313da6a688084711130da18e1af7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:57,279 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.1-py3-none-any.whl#sha256=796615edf52f5673187a884a9d77c7d755fe95ca2d16fe77a1f042730eb957b3 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:57,280 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.0-py3-none-any.whl#sha256=1a863b5f478f2e66e921dbbf2e4dcda06a923021763f01b59c5b03bdd3af01c2 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:37:57,280 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.3.0-py3-none-any.whl#sha256=498b8b8954c1f9c17f46e3ec096e9be6b9c96ee70560ee613a4eb9c7b9d31644 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:37:57,280 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.2.0-py3-none-any.whl#sha256=e06d3d7b6016be832e6889cbc9c4787b99156ba57f8feb31d3aeb27304c6558c (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:37:57,281 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.0.1-py3-none-any.whl#sha256=0afc289f69286f71017fb9811dfea6cda7c703bf693ad43106fbbff1f164cf14 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:37:57,281 Skipping link: not a file: https://www.piwheels.org/simple/lm-eval/ 2026-09-01T00:37:57,282 Skipping link: not a file: https://pypi.org/simple/lm-eval/ 2026-09-01T00:37:57,303 Given no hashes to check 1 links for project 'lm-eval': discarding no candidates 2026-09-01T00:37:57,321 Collecting lm-eval==0.4.13 2026-09-01T00:37:57,324 Created temporary directory: /tmp/pip-unpack-fpafd1s7 2026-09-01T00:37:57,567 Downloading lm_eval-0.4.13.tar.gz (3.5 MB) 2026-09-01T00:38:22,042 Added lm-eval==0.4.13 from https://files.pythonhosted.org/packages/89/b1/cfcdf2a8c8b8e755ec7103a7d4b6f8673f7916641ca08df83412c531935b/lm_eval-0.4.13.tar.gz to build tracker '/tmp/pip-build-tracker-af640hge' 2026-09-01T00:38:22,050 Created temporary directory: /tmp/pip-build-env-m_2d4xh4 2026-09-01T00:38:22,055 Installing build dependencies: started 2026-09-01T00:38:22,056 Running command pip subprocess to install build dependencies 2026-09-01T00:38:23,206 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2026-09-01T00:38:23,675 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-09-01T00:38:23,698 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-09-01T00:38:25,538 Collecting setuptools>=64.0 2026-09-01T00:38:25,539 Obtaining dependency information for setuptools>=64.0 from https://www.piwheels.org/simple/setuptools/setuptools-84.0.0-py3-none-any.whl.metadata 2026-09-01T00:38:25,554 Using cached https://www.piwheels.org/simple/setuptools/setuptools-84.0.0-py3-none-any.whl.metadata (6.6 kB) 2026-09-01T00:38:25,808 Using cached https://www.piwheels.org/simple/setuptools/setuptools-84.0.0-py3-none-any.whl (818 kB) 2026-09-01T00:38:25,896 Using cached https://www.piwheels.org/simple/setuptools/setuptools-84.0.0-py3-none-any.whl (818 kB) 2026-09-01T00:38:28,647 Installing collected packages: setuptools 2026-09-01T00:38:30,939 Successfully installed setuptools-84.0.0 2026-09-01T00:38:31,209 Installing build dependencies: finished with status 'done' 2026-09-01T00:38:31,216 Getting requirements to build wheel: started 2026-09-01T00:38:31,217 Running command Getting requirements to build wheel 2026-09-01T00:38:32,537 /tmp/pip-build-env-m_2d4xh4/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-09-01T00:38:32,537 !! 2026-09-01T00:38:32,538 ******************************************************************************** 2026-09-01T00:38:32,539 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-09-01T00:38:32,540 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-09-01T00:38:32,540 or your builds will no longer be supported. 2026-09-01T00:38:32,541 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-09-01T00:38:32,542 ******************************************************************************** 2026-09-01T00:38:32,543 !! 2026-09-01T00:38:32,543 corresp(dist, value, root_dir) 2026-09-01T00:38:32,638 running egg_info 2026-09-01T00:38:32,644 writing lm_eval.egg-info/PKG-INFO 2026-09-01T00:38:32,669 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2026-09-01T00:38:32,671 writing entry points to lm_eval.egg-info/entry_points.txt 2026-09-01T00:38:32,683 writing requirements to lm_eval.egg-info/requires.txt 2026-09-01T00:38:32,685 writing top-level names to lm_eval.egg-info/top_level.txt 2026-09-01T00:38:36,150 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:38:36,930 reading manifest template 'MANIFEST.in' 2026-09-01T00:38:36,931 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-09-01T00:38:36,932 adding license file 'LICENSE.md' 2026-09-01T00:38:37,797 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:38:37,928 Getting requirements to build wheel: finished with status 'done' 2026-09-01T00:38:37,932 Created temporary directory: /tmp/pip-modern-metadata-g2my8fmy 2026-09-01T00:38:37,934 Preparing metadata (pyproject.toml): started 2026-09-01T00:38:37,936 Running command Preparing metadata (pyproject.toml) 2026-09-01T00:38:38,833 /tmp/pip-build-env-m_2d4xh4/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-09-01T00:38:38,833 !! 2026-09-01T00:38:38,835 ******************************************************************************** 2026-09-01T00:38:38,835 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-09-01T00:38:38,837 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-09-01T00:38:38,837 or your builds will no longer be supported. 2026-09-01T00:38:38,838 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-09-01T00:38:38,839 ******************************************************************************** 2026-09-01T00:38:38,840 !! 2026-09-01T00:38:38,841 corresp(dist, value, root_dir) 2026-09-01T00:38:38,941 running dist_info 2026-09-01T00:38:38,951 creating /tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info 2026-09-01T00:38:38,952 writing /tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info/PKG-INFO 2026-09-01T00:38:38,977 writing dependency_links to /tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info/dependency_links.txt 2026-09-01T00:38:38,978 writing entry points to /tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info/entry_points.txt 2026-09-01T00:38:38,991 writing requirements to /tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info/requires.txt 2026-09-01T00:38:38,993 writing top-level names to /tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info/top_level.txt 2026-09-01T00:38:38,994 writing manifest file '/tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:38:44,859 reading manifest file '/tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:38:44,862 reading manifest template 'MANIFEST.in' 2026-09-01T00:38:44,862 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-09-01T00:38:44,863 adding license file 'LICENSE.md' 2026-09-01T00:38:45,408 writing manifest file '/tmp/pip-modern-metadata-g2my8fmy/lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:38:45,430 creating '/tmp/pip-modern-metadata-g2my8fmy/lm_eval-0.4.13.dist-info' 2026-09-01T00:38:45,588 Preparing metadata (pyproject.toml): finished with status 'done' 2026-09-01T00:38:45,598 Source in /tmp/pip-wheel-7j_poii0/lm-eval_25efff169bb243279ebda8b745b78fe5 has version 0.4.13, which satisfies requirement lm-eval==0.4.13 from https://files.pythonhosted.org/packages/89/b1/cfcdf2a8c8b8e755ec7103a7d4b6f8673f7916641ca08df83412c531935b/lm_eval-0.4.13.tar.gz 2026-09-01T00:38:45,599 Removed lm-eval==0.4.13 from https://files.pythonhosted.org/packages/89/b1/cfcdf2a8c8b8e755ec7103a7d4b6f8673f7916641ca08df83412c531935b/lm_eval-0.4.13.tar.gz from build tracker '/tmp/pip-build-tracker-af640hge' 2026-09-01T00:38:45,613 Created temporary directory: /tmp/pip-unpack-0ucbsmnr 2026-09-01T00:38:45,614 Building wheels for collected packages: lm-eval 2026-09-01T00:38:45,618 Created temporary directory: /tmp/pip-wheel-dqt2b72a 2026-09-01T00:38:45,619 Destination directory: /tmp/pip-wheel-dqt2b72a 2026-09-01T00:38:45,621 Building wheel for lm-eval (pyproject.toml): started 2026-09-01T00:38:45,622 Running command Building wheel for lm-eval (pyproject.toml) 2026-09-01T00:38:46,463 /tmp/pip-build-env-m_2d4xh4/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-09-01T00:38:46,464 !! 2026-09-01T00:38:46,465 ******************************************************************************** 2026-09-01T00:38:46,465 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-09-01T00:38:46,467 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-09-01T00:38:46,468 or your builds will no longer be supported. 2026-09-01T00:38:46,469 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-09-01T00:38:46,470 ******************************************************************************** 2026-09-01T00:38:46,471 !! 2026-09-01T00:38:46,471 corresp(dist, value, root_dir) 2026-09-01T00:38:46,558 running bdist_wheel 2026-09-01T00:38:46,576 running build 2026-09-01T00:38:46,577 running build_py 2026-09-01T00:38:46,584 creating build/lib/lm_eval 2026-09-01T00:38:46,586 copying lm_eval/evaluator.py -> build/lib/lm_eval 2026-09-01T00:38:46,589 copying lm_eval/__init__.py -> build/lib/lm_eval 2026-09-01T00:38:46,591 copying lm_eval/evaluator_utils.py -> build/lib/lm_eval 2026-09-01T00:38:46,594 copying lm_eval/utils.py -> build/lib/lm_eval 2026-09-01T00:38:46,597 copying lm_eval/result_schema.py -> build/lib/lm_eval 2026-09-01T00:38:46,599 copying lm_eval/__main__.py -> build/lib/lm_eval 2026-09-01T00:38:46,601 copying lm_eval/defaults.py -> build/lib/lm_eval 2026-09-01T00:38:46,604 creating build/lib/lm_eval/caching 2026-09-01T00:38:46,605 copying lm_eval/caching/__init__.py -> build/lib/lm_eval/caching 2026-09-01T00:38:46,607 copying lm_eval/caching/cache.py -> build/lib/lm_eval/caching 2026-09-01T00:38:46,609 creating build/lib/lm_eval/filters 2026-09-01T00:38:46,610 copying lm_eval/filters/selection.py -> build/lib/lm_eval/filters 2026-09-01T00:38:46,612 copying lm_eval/filters/custom.py -> build/lib/lm_eval/filters 2026-09-01T00:38:46,614 copying lm_eval/filters/__init__.py -> build/lib/lm_eval/filters 2026-09-01T00:38:46,616 copying lm_eval/filters/extraction.py -> build/lib/lm_eval/filters 2026-09-01T00:38:46,619 copying lm_eval/filters/transformation.py -> build/lib/lm_eval/filters 2026-09-01T00:38:46,621 copying lm_eval/filters/decontamination.py -> build/lib/lm_eval/filters 2026-09-01T00:38:46,623 creating build/lib/lm_eval/config 2026-09-01T00:38:46,624 copying lm_eval/config/__init__.py -> build/lib/lm_eval/config 2026-09-01T00:38:46,626 copying lm_eval/config/evaluate_config.py -> build/lib/lm_eval/config 2026-09-01T00:38:46,629 copying lm_eval/config/task.py -> build/lib/lm_eval/config 2026-09-01T00:38:46,631 copying lm_eval/config/group.py -> build/lib/lm_eval/config 2026-09-01T00:38:46,634 creating build/lib/lm_eval/models 2026-09-01T00:38:46,635 copying lm_eval/models/textsynth.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,638 copying lm_eval/models/trtllm_causallms.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,640 copying lm_eval/models/nemo_lm.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,643 copying lm_eval/models/hf_audiolm.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,645 copying lm_eval/models/gguf.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,648 copying lm_eval/models/onnxruntime_genai.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,650 copying lm_eval/models/optimum_lm.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,652 copying lm_eval/models/api_models.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,655 copying lm_eval/models/onnxruntime_ort.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,657 copying lm_eval/models/litellm_llms.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,660 copying lm_eval/models/vllm_vlms.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,662 copying lm_eval/models/hf_vlms.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,665 copying lm_eval/models/megatron_lm.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,668 copying lm_eval/models/sglang_generate_API.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,670 copying lm_eval/models/mamba_lm.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,672 copying lm_eval/models/__init__.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,674 copying lm_eval/models/mistral3.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,676 copying lm_eval/models/utils.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,679 copying lm_eval/models/sglang_causallms.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,682 copying lm_eval/models/optimum_ipex.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,684 copying lm_eval/models/utils_hf.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,686 copying lm_eval/models/anthropic_llms.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,689 copying lm_eval/models/neuron_optimum.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,691 copying lm_eval/models/winml.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,694 copying lm_eval/models/vllm_causallms.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,697 copying lm_eval/models/_onnx_base.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,699 copying lm_eval/models/openai_completions.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,702 copying lm_eval/models/optimum_habana.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,704 copying lm_eval/models/huggingface.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,708 copying lm_eval/models/dummy.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,710 copying lm_eval/models/hf_steered.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,713 copying lm_eval/models/ibm_watsonx_ai.py -> build/lib/lm_eval/models 2026-09-01T00:38:46,716 creating build/lib/lm_eval/prompts 2026-09-01T00:38:46,717 copying lm_eval/prompts/__init__.py -> build/lib/lm_eval/prompts 2026-09-01T00:38:46,720 creating build/lib/lm_eval/loggers 2026-09-01T00:38:46,721 copying lm_eval/loggers/trackio_logger.py -> build/lib/lm_eval/loggers 2026-09-01T00:38:46,723 copying lm_eval/loggers/__init__.py -> build/lib/lm_eval/loggers 2026-09-01T00:38:46,725 copying lm_eval/loggers/utils.py -> build/lib/lm_eval/loggers 2026-09-01T00:38:46,728 copying lm_eval/loggers/wandb_logger.py -> build/lib/lm_eval/loggers 2026-09-01T00:38:46,730 copying lm_eval/loggers/evaluation_tracker.py -> build/lib/lm_eval/loggers 2026-09-01T00:38:46,734 creating build/lib/lm_eval/tasks 2026-09-01T00:38:46,735 copying lm_eval/tasks/manager.py -> build/lib/lm_eval/tasks 2026-09-01T00:38:46,737 copying lm_eval/tasks/_yaml_loader.py -> build/lib/lm_eval/tasks 2026-09-01T00:38:46,740 copying lm_eval/tasks/_index.py -> build/lib/lm_eval/tasks 2026-09-01T00:38:46,742 copying lm_eval/tasks/__init__.py -> build/lib/lm_eval/tasks 2026-09-01T00:38:46,744 copying lm_eval/tasks/_factory.py -> build/lib/lm_eval/tasks 2026-09-01T00:38:46,747 creating build/lib/lm_eval/_cli 2026-09-01T00:38:46,748 copying lm_eval/_cli/ls.py -> build/lib/lm_eval/_cli 2026-09-01T00:38:46,750 copying lm_eval/_cli/harness.py -> build/lib/lm_eval/_cli 2026-09-01T00:38:46,752 copying lm_eval/_cli/__init__.py -> build/lib/lm_eval/_cli 2026-09-01T00:38:46,754 copying lm_eval/_cli/utils.py -> build/lib/lm_eval/_cli 2026-09-01T00:38:46,756 copying lm_eval/_cli/validate.py -> build/lib/lm_eval/_cli 2026-09-01T00:38:46,759 copying lm_eval/_cli/subcommand.py -> build/lib/lm_eval/_cli 2026-09-01T00:38:46,760 copying lm_eval/_cli/run.py -> build/lib/lm_eval/_cli 2026-09-01T00:38:46,763 creating build/lib/lm_eval/decontamination 2026-09-01T00:38:46,764 copying lm_eval/decontamination/janitor.py -> build/lib/lm_eval/decontamination 2026-09-01T00:38:46,767 copying lm_eval/decontamination/archiver.py -> build/lib/lm_eval/decontamination 2026-09-01T00:38:46,769 copying lm_eval/decontamination/__init__.py -> build/lib/lm_eval/decontamination 2026-09-01T00:38:46,770 copying lm_eval/decontamination/decontaminate.py -> build/lib/lm_eval/decontamination 2026-09-01T00:38:46,773 creating build/lib/lm_eval/api 2026-09-01T00:38:46,775 copying lm_eval/api/model.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,777 copying lm_eval/api/instance.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,779 copying lm_eval/api/metrics.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,782 copying lm_eval/api/filter.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,784 copying lm_eval/api/registry.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,787 copying lm_eval/api/__init__.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,789 copying lm_eval/api/utils.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,791 copying lm_eval/api/samplers.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,793 copying lm_eval/api/task.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,796 copying lm_eval/api/group.py -> build/lib/lm_eval/api 2026-09-01T00:38:46,799 creating build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:38:46,800 copying lm_eval/tasks/hendrycks_ethics/utils.py -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:38:46,803 creating build/lib/lm_eval/tasks/mbpp 2026-09-01T00:38:46,804 copying lm_eval/tasks/mbpp/utils.py -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:38:46,807 creating build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:38:46,808 copying lm_eval/tasks/truthfulqa/utils.py -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:38:46,811 creating build/lib/lm_eval/tasks/c4 2026-09-01T00:38:46,812 copying lm_eval/tasks/c4/preprocess_c4.py -> build/lib/lm_eval/tasks/c4 2026-09-01T00:38:46,816 creating build/lib/lm_eval/tasks/lingoly 2026-09-01T00:38:46,818 copying lm_eval/tasks/lingoly/utils.py -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:38:46,820 copying lm_eval/tasks/lingoly/script.py -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:38:46,822 creating build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:38:46,823 copying lm_eval/tasks/mmlu-pro-plus/utils.py -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:38:46,826 creating build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:38:46,827 copying lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:38:46,829 copying lm_eval/tasks/mimic_repsum/utils.py -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:38:46,832 creating build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:38:46,833 copying lm_eval/tasks/egymmlu/utils.py -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:38:46,835 copying lm_eval/tasks/egymmlu/_generate_configs.py -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:38:46,838 creating build/lib/lm_eval/tasks/aime 2026-09-01T00:38:46,839 copying lm_eval/tasks/aime/utils.py -> build/lib/lm_eval/tasks/aime 2026-09-01T00:38:46,841 creating build/lib/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:38:46,842 copying lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:38:46,845 creating build/lib/lm_eval/tasks/wmt2016 2026-09-01T00:38:46,846 copying lm_eval/tasks/wmt2016/metrics.py -> build/lib/lm_eval/tasks/wmt2016 2026-09-01T00:38:46,848 creating build/lib/lm_eval/tasks/xcopa 2026-09-01T00:38:46,849 copying lm_eval/tasks/xcopa/utils.py -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:38:46,852 creating build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:38:46,853 copying lm_eval/tasks/eus_exams/utils.py -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:38:46,855 copying lm_eval/tasks/eus_exams/configs.py -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:38:46,857 creating build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:38:46,858 copying lm_eval/tasks/cruxeval/utils.py -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:38:46,862 creating build/lib/lm_eval/tasks/translation 2026-09-01T00:38:46,863 copying lm_eval/tasks/translation/utils.py -> build/lib/lm_eval/tasks/translation 2026-09-01T00:38:46,865 creating build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:38:46,866 copying lm_eval/tasks/galician_bench/utils.py -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:38:46,870 creating build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:38:46,871 copying lm_eval/tasks/greekmmlu/utils.py -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:38:46,873 copying lm_eval/tasks/greekmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:38:46,876 creating build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:38:46,877 copying lm_eval/tasks/openai-mmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:38:46,880 creating build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,881 copying lm_eval/tasks/ruler/vt_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,883 copying lm_eval/tasks/ruler/prepare_niah.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,886 copying lm_eval/tasks/ruler/essays.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,888 copying lm_eval/tasks/ruler/qa_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,891 copying lm_eval/tasks/ruler/cwe_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,893 copying lm_eval/tasks/ruler/niah_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,896 copying lm_eval/tasks/ruler/common_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,898 copying lm_eval/tasks/ruler/fwe_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:38:46,901 creating build/lib/lm_eval/tasks/cabbq 2026-09-01T00:38:46,902 copying lm_eval/tasks/cabbq/utils.py -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:38:46,906 creating build/lib/lm_eval/tasks/eq_bench 2026-09-01T00:38:46,907 copying lm_eval/tasks/eq_bench/utils.py -> build/lib/lm_eval/tasks/eq_bench 2026-09-01T00:38:46,910 creating build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:38:46,911 copying lm_eval/tasks/catalan_bench/utils.py -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:38:46,914 creating build/lib/lm_eval/tasks/babilong 2026-09-01T00:38:46,916 copying lm_eval/tasks/babilong/common_utils.py -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:38:46,919 creating build/lib/lm_eval/tasks/csatqa 2026-09-01T00:38:46,920 copying lm_eval/tasks/csatqa/utils.py -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:38:46,922 copying lm_eval/tasks/csatqa/_generate_configs.py -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:38:46,924 creating build/lib/lm_eval/tasks/mgsm 2026-09-01T00:38:46,925 copying lm_eval/tasks/mgsm/utils.py -> build/lib/lm_eval/tasks/mgsm 2026-09-01T00:38:46,928 creating build/lib/lm_eval/tasks/meddialog 2026-09-01T00:38:46,929 copying lm_eval/tasks/meddialog/utils_perplexity.py -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:38:46,931 copying lm_eval/tasks/meddialog/utils.py -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:38:46,934 creating build/lib/lm_eval/tasks/belebele 2026-09-01T00:38:46,935 copying lm_eval/tasks/belebele/_generate_configs.py -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:38:46,937 creating build/lib/lm_eval/tasks/paws-x 2026-09-01T00:38:46,938 copying lm_eval/tasks/paws-x/_generate_config.py -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:38:46,941 copying lm_eval/tasks/paws-x/utils.py -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:38:46,943 creating build/lib/lm_eval/tasks/copal_id 2026-09-01T00:38:46,944 copying lm_eval/tasks/copal_id/utils.py -> build/lib/lm_eval/tasks/copal_id 2026-09-01T00:38:46,946 creating build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:38:46,947 copying lm_eval/tasks/afrimgsm/utils.py -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:38:46,950 copying lm_eval/tasks/afrimgsm/gen_utils.py -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:38:46,953 creating build/lib/lm_eval/tasks/mlqa 2026-09-01T00:38:46,954 copying lm_eval/tasks/mlqa/utils.py -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:38:46,956 copying lm_eval/tasks/mlqa/generate_tasks.py -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:38:46,958 creating build/lib/lm_eval/tasks/pisa 2026-09-01T00:38:46,960 copying lm_eval/tasks/pisa/utils.py -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:38:46,963 creating build/lib/lm_eval/tasks/winogender 2026-09-01T00:38:46,964 copying lm_eval/tasks/winogender/utils.py -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:38:46,967 creating build/lib/lm_eval/tasks/med_prescriptions 2026-09-01T00:38:46,968 copying lm_eval/tasks/med_prescriptions/utils.py -> build/lib/lm_eval/tasks/med_prescriptions 2026-09-01T00:38:46,973 creating build/lib/lm_eval/tasks/groundcocoa 2026-09-01T00:38:46,974 copying lm_eval/tasks/groundcocoa/utils.py -> build/lib/lm_eval/tasks/groundcocoa 2026-09-01T00:38:46,977 creating build/lib/lm_eval/tasks/fda 2026-09-01T00:38:46,978 copying lm_eval/tasks/fda/task.py -> build/lib/lm_eval/tasks/fda 2026-09-01T00:38:46,982 creating build/lib/lm_eval/tasks/xquad 2026-09-01T00:38:46,983 copying lm_eval/tasks/xquad/utils.py -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:38:46,985 creating build/lib/lm_eval/tasks/afrixnli 2026-09-01T00:38:46,986 copying lm_eval/tasks/afrixnli/utils.py -> build/lib/lm_eval/tasks/afrixnli 2026-09-01T00:38:46,989 copying lm_eval/tasks/afrixnli/gen_utils.py -> build/lib/lm_eval/tasks/afrixnli 2026-09-01T00:38:46,992 creating build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:38:46,993 copying lm_eval/tasks/arab_culture/utils_mcq.py -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:38:46,995 copying lm_eval/tasks/arab_culture/prompts.py -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:38:46,997 copying lm_eval/tasks/arab_culture/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:38:47,000 creating build/lib/lm_eval/tasks/pubmedqa 2026-09-01T00:38:47,001 copying lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/lib/lm_eval/tasks/pubmedqa 2026-09-01T00:38:47,004 creating build/lib/lm_eval/tasks/agieval 2026-09-01T00:38:47,005 copying lm_eval/tasks/agieval/utils.py -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:38:47,009 creating build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:38:47,010 copying lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:38:47,012 copying lm_eval/tasks/mts_dialog/utils.py -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:38:47,015 creating build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:38:47,016 copying lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:38:47,019 creating build/lib/lm_eval/tasks/toksuite 2026-09-01T00:38:47,020 copying lm_eval/tasks/toksuite/utils.py -> build/lib/lm_eval/tasks/toksuite 2026-09-01T00:38:47,024 creating build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:38:47,025 copying lm_eval/tasks/evalita_llm/metrics.py -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:38:47,027 copying lm_eval/tasks/evalita_llm/utils.py -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:38:47,030 copying lm_eval/tasks/evalita_llm/sum_utils.py -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:38:47,032 creating build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:38:47,033 copying lm_eval/tasks/infinitebench/utils.py -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:38:47,036 creating build/lib/lm_eval/tasks/wsc273 2026-09-01T00:38:47,037 copying lm_eval/tasks/wsc273/utils.py -> build/lib/lm_eval/tasks/wsc273 2026-09-01T00:38:47,039 creating build/lib/lm_eval/tasks/logiqa 2026-09-01T00:38:47,040 copying lm_eval/tasks/logiqa/utils_logiqa.py -> build/lib/lm_eval/tasks/logiqa 2026-09-01T00:38:47,043 creating build/lib/lm_eval/tasks/histoires_morales 2026-09-01T00:38:47,044 copying lm_eval/tasks/histoires_morales/utils.py -> build/lib/lm_eval/tasks/histoires_morales 2026-09-01T00:38:47,046 creating build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:38:47,048 copying lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:38:47,050 creating build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:38:47,051 copying lm_eval/tasks/truthfulqa-multi/utils.py -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:38:47,054 creating build/lib/lm_eval/tasks/scrolls 2026-09-01T00:38:47,055 copying lm_eval/tasks/scrolls/task.py -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:38:47,059 creating build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:38:47,060 copying lm_eval/tasks/hendrycks_math/utils.py -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:38:47,063 creating build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:38:47,064 copying lm_eval/tasks/mmlu_prox/lang_libs.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:38:47,066 copying lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:38:47,069 copying lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:38:47,072 creating build/lib/lm_eval/tasks/xnli 2026-09-01T00:38:47,073 copying lm_eval/tasks/xnli/utils.py -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:38:47,076 creating build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:38:47,077 copying lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:38:47,079 copying lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:38:47,081 copying lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:38:47,083 copying lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:38:47,086 creating build/lib/lm_eval/tasks/meqsum 2026-09-01T00:38:47,087 copying lm_eval/tasks/meqsum/utils.py -> build/lib/lm_eval/tasks/meqsum 2026-09-01T00:38:47,089 creating build/lib/lm_eval/tasks/glianorex 2026-09-01T00:38:47,090 copying lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:38:47,092 creating build/lib/lm_eval/tasks/egyhellaswag 2026-09-01T00:38:47,093 copying lm_eval/tasks/egyhellaswag/utils.py -> build/lib/lm_eval/tasks/egyhellaswag 2026-09-01T00:38:47,096 creating build/lib/lm_eval/tasks/swde 2026-09-01T00:38:47,097 copying lm_eval/tasks/swde/task.py -> build/lib/lm_eval/tasks/swde 2026-09-01T00:38:47,099 creating build/lib/lm_eval/tasks/cnn_dailymail 2026-09-01T00:38:47,100 copying lm_eval/tasks/cnn_dailymail/utils.py -> build/lib/lm_eval/tasks/cnn_dailymail 2026-09-01T00:38:47,103 creating build/lib/lm_eval/tasks/aclue 2026-09-01T00:38:47,104 copying lm_eval/tasks/aclue/_generate_configs.py -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:38:47,107 creating build/lib/lm_eval/tasks/chartqa 2026-09-01T00:38:47,108 copying lm_eval/tasks/chartqa/utils.py -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:38:47,111 creating build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:38:47,112 copying lm_eval/tasks/jsonschema_bench/metrics.py -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:38:47,115 creating build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:38:47,116 copying lm_eval/tasks/physics_gre/utils.py -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:38:47,119 creating build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:38:47,120 copying lm_eval/tasks/slr_bench/lm_eval_slr_bench.py -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:38:47,123 creating build/lib/lm_eval/tasks/squad_completion 2026-09-01T00:38:47,124 copying lm_eval/tasks/squad_completion/task.py -> build/lib/lm_eval/tasks/squad_completion 2026-09-01T00:38:47,128 creating build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:38:47,129 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:38:47,130 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:38:47,132 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:38:47,134 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:38:47,137 creating build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:38:47,138 copying lm_eval/tasks/basque_bench/utils.py -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:38:47,140 creating build/lib/lm_eval/tasks/french_bench 2026-09-01T00:38:47,141 copying lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:38:47,143 copying lm_eval/tasks/french_bench/utils.py -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:38:47,146 creating build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:38:47,147 copying lm_eval/tasks/darijammlu/utils.py -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:38:47,149 copying lm_eval/tasks/darijammlu/_generate_configs.py -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:38:47,151 creating build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:38:47,152 copying lm_eval/tasks/kormedmcqa/utils.py -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:38:47,155 creating build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:38:47,156 copying lm_eval/tasks/cmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:38:47,159 creating build/lib/lm_eval/tasks/mmmu 2026-09-01T00:38:47,160 copying lm_eval/tasks/mmmu/utils.py -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:38:47,163 creating build/lib/lm_eval/tasks/eus_trivia 2026-09-01T00:38:47,165 copying lm_eval/tasks/eus_trivia/utils.py -> build/lib/lm_eval/tasks/eus_trivia 2026-09-01T00:38:47,168 creating build/lib/lm_eval/tasks/longbench 2026-09-01T00:38:47,169 copying lm_eval/tasks/longbench/metrics.py -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:38:47,172 copying lm_eval/tasks/longbench/_generate_config.py -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:38:47,175 copying lm_eval/tasks/longbench/utils.py -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:38:47,178 creating build/lib/lm_eval/tasks/kobest 2026-09-01T00:38:47,179 copying lm_eval/tasks/kobest/utils.py -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:38:47,182 creating build/lib/lm_eval/tasks/realtoxicityprompts 2026-09-01T00:38:47,183 copying lm_eval/tasks/realtoxicityprompts/metric.py -> build/lib/lm_eval/tasks/realtoxicityprompts 2026-09-01T00:38:47,186 creating build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:38:47,187 copying lm_eval/tasks/portuguese_bench/assin2_utils.py -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:38:47,190 creating build/lib/lm_eval/tasks/longproc 2026-09-01T00:38:47,191 copying lm_eval/tasks/longproc/metrics.py -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:38:47,193 copying lm_eval/tasks/longproc/utils.py -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:38:47,197 creating build/lib/lm_eval/tasks/mathqa 2026-09-01T00:38:47,198 copying lm_eval/tasks/mathqa/utils.py -> build/lib/lm_eval/tasks/mathqa 2026-09-01T00:38:47,201 creating build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:38:47,202 copying lm_eval/tasks/crows_pairs/utils.py -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:38:47,205 creating build/lib/lm_eval/tasks/darijahellaswag 2026-09-01T00:38:47,206 copying lm_eval/tasks/darijahellaswag/utils.py -> build/lib/lm_eval/tasks/darijahellaswag 2026-09-01T00:38:47,208 creating build/lib/lm_eval/tasks/bbh 2026-09-01T00:38:47,209 copying lm_eval/tasks/bbh/_generate_configs.py -> build/lib/lm_eval/tasks/bbh 2026-09-01T00:38:47,212 creating build/lib/lm_eval/tasks/med_text_classification 2026-09-01T00:38:47,213 copying lm_eval/tasks/med_text_classification/utils.py -> build/lib/lm_eval/tasks/med_text_classification 2026-09-01T00:38:47,215 creating build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:38:47,216 copying lm_eval/tasks/discrim_eval/utils.py -> build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:38:47,219 creating build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:38:47,220 copying lm_eval/tasks/arabicmmlu/utils.py -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:38:47,222 copying lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:38:47,225 creating build/lib/lm_eval/tasks/toxigen 2026-09-01T00:38:47,226 copying lm_eval/tasks/toxigen/utils.py -> build/lib/lm_eval/tasks/toxigen 2026-09-01T00:38:47,228 creating build/lib/lm_eval/tasks/eus_reading 2026-09-01T00:38:47,229 copying lm_eval/tasks/eus_reading/utils.py -> build/lib/lm_eval/tasks/eus_reading 2026-09-01T00:38:47,231 creating build/lib/lm_eval/tasks/ceval 2026-09-01T00:38:47,232 copying lm_eval/tasks/ceval/_generate_configs.py -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:38:47,237 creating build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:38:47,238 copying lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:38:47,240 creating build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:38:47,241 copying lm_eval/tasks/basqueglue/utils.py -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:38:47,244 creating build/lib/lm_eval/tasks/coqa 2026-09-01T00:38:47,245 copying lm_eval/tasks/coqa/utils.py -> build/lib/lm_eval/tasks/coqa 2026-09-01T00:38:47,247 creating build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:38:47,248 copying lm_eval/tasks/afrimmlu/utils.py -> build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:38:47,250 copying lm_eval/tasks/afrimmlu/gen_utils.py -> build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:38:47,252 creating build/lib/lm_eval/tasks/humaneval 2026-09-01T00:38:47,253 copying lm_eval/tasks/humaneval/utils.py -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:38:47,256 creating build/lib/lm_eval/tasks/score 2026-09-01T00:38:47,257 copying lm_eval/tasks/score/utils.py -> build/lib/lm_eval/tasks/score 2026-09-01T00:38:47,260 copying lm_eval/tasks/score/non_greedy_summarizer.py -> build/lib/lm_eval/tasks/score 2026-09-01T00:38:47,263 creating build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:38:47,264 copying lm_eval/tasks/spanish_bench/utils.py -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:38:47,266 creating build/lib/lm_eval/tasks/careqa 2026-09-01T00:38:47,267 copying lm_eval/tasks/careqa/utils_perplexity.py -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:38:47,269 copying lm_eval/tasks/careqa/utils.py -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:38:47,271 copying lm_eval/tasks/careqa/utils_open.py -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:38:47,274 creating build/lib/lm_eval/tasks/drop 2026-09-01T00:38:47,275 copying lm_eval/tasks/drop/utils.py -> build/lib/lm_eval/tasks/drop 2026-09-01T00:38:47,278 creating build/lib/lm_eval/tasks/indicparam 2026-09-01T00:38:47,279 copying lm_eval/tasks/indicparam/utils.py -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:38:47,281 creating build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:38:47,282 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_utils.py -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:38:47,285 creating build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:38:47,285 copying lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:38:47,287 copying lm_eval/tasks/mediqa_qa2019/utils.py -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:38:47,289 creating build/lib/lm_eval/tasks/webqs 2026-09-01T00:38:47,290 copying lm_eval/tasks/webqs/utils.py -> build/lib/lm_eval/tasks/webqs 2026-09-01T00:38:47,293 creating build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:38:47,294 copying lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:38:47,296 creating build/lib/lm_eval/tasks/mmlusr 2026-09-01T00:38:47,297 copying lm_eval/tasks/mmlusr/config.py -> build/lib/lm_eval/tasks/mmlusr 2026-09-01T00:38:47,300 creating build/lib/lm_eval/tasks/ifeval 2026-09-01T00:38:47,301 copying lm_eval/tasks/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:38:47,304 copying lm_eval/tasks/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:38:47,306 copying lm_eval/tasks/ifeval/instructions.py -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:38:47,309 copying lm_eval/tasks/ifeval/utils.py -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:38:47,312 creating build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:38:47,313 copying lm_eval/tasks/humaneval_infilling/utils.py -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:38:47,315 creating build/lib/lm_eval/tasks/unitxt 2026-09-01T00:38:47,316 copying lm_eval/tasks/unitxt/task.py -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:38:47,319 creating build/lib/lm_eval/tasks/mutual 2026-09-01T00:38:47,320 copying lm_eval/tasks/mutual/utils.py -> build/lib/lm_eval/tasks/mutual 2026-09-01T00:38:47,323 creating build/lib/lm_eval/tasks/bbq 2026-09-01T00:38:47,324 copying lm_eval/tasks/bbq/utils.py -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:38:47,327 creating build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:38:47,328 copying lm_eval/tasks/tydiqa/utils.py -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:38:47,331 creating build/lib/lm_eval/tasks/mmlu 2026-09-01T00:38:47,332 copying lm_eval/tasks/mmlu/_generate_configs.py -> build/lib/lm_eval/tasks/mmlu 2026-09-01T00:38:47,334 creating build/lib/lm_eval/tasks/wikitext 2026-09-01T00:38:47,335 copying lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/lib/lm_eval/tasks/wikitext 2026-09-01T00:38:47,338 creating build/lib/lm_eval/tasks/medqa 2026-09-01T00:38:47,339 copying lm_eval/tasks/medqa/preprocess_medqa.py -> build/lib/lm_eval/tasks/medqa 2026-09-01T00:38:47,341 creating build/lib/lm_eval/tasks/medtext 2026-09-01T00:38:47,342 copying lm_eval/tasks/medtext/utils_perplexity.py -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:38:47,344 copying lm_eval/tasks/medtext/utils.py -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:38:47,346 creating build/lib/lm_eval/tasks/noticia 2026-09-01T00:38:47,347 copying lm_eval/tasks/noticia/utils.py -> build/lib/lm_eval/tasks/noticia 2026-09-01T00:38:47,349 creating build/lib/lm_eval/tasks/olaph 2026-09-01T00:38:47,350 copying lm_eval/tasks/olaph/utils_perplexity.py -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:38:47,352 copying lm_eval/tasks/olaph/utils.py -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:38:47,355 creating build/lib/lm_eval/tasks/race 2026-09-01T00:38:47,356 copying lm_eval/tasks/race/preprocess_race.py -> build/lib/lm_eval/tasks/race 2026-09-01T00:38:47,358 creating build/lib/lm_eval/tasks/metabench 2026-09-01T00:38:47,359 copying lm_eval/tasks/metabench/process_docs_permute.py -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:38:47,361 copying lm_eval/tasks/metabench/process_docs.py -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:38:47,364 creating build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:38:47,364 copying lm_eval/tasks/xwinograd/utils.py -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:38:47,368 creating build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:38:47,368 copying lm_eval/tasks/arab_culture_completion/prompts.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:38:47,371 copying lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:38:47,372 copying lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:38:47,375 creating build/lib/lm_eval/tasks/paloma 2026-09-01T00:38:47,376 copying lm_eval/tasks/paloma/paloma_utils.py -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:38:47,378 creating build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:38:47,379 copying lm_eval/tasks/graphwalks/utils.py -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:38:47,382 creating build/lib/lm_eval/tasks/moral_stories 2026-09-01T00:38:47,383 copying lm_eval/tasks/moral_stories/utils.py -> build/lib/lm_eval/tasks/moral_stories 2026-09-01T00:38:47,386 creating build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:38:47,387 copying lm_eval/tasks/putnam_axiom/utils.py -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:38:47,390 creating build/lib/lm_eval/tasks/common_voice 2026-09-01T00:38:47,391 copying lm_eval/tasks/common_voice/utils.py -> build/lib/lm_eval/tasks/common_voice 2026-09-01T00:38:47,394 creating build/lib/lm_eval/tasks/qasper 2026-09-01T00:38:47,395 copying lm_eval/tasks/qasper/metrics.py -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:38:47,397 copying lm_eval/tasks/qasper/utils.py -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:38:47,399 creating build/lib/lm_eval/tasks/hellaswag 2026-09-01T00:38:47,400 copying lm_eval/tasks/hellaswag/utils.py -> build/lib/lm_eval/tasks/hellaswag 2026-09-01T00:38:47,403 creating build/lib/lm_eval/tasks/esbbq 2026-09-01T00:38:47,404 copying lm_eval/tasks/esbbq/utils.py -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:38:47,407 creating build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:38:47,407 copying lm_eval/tasks/jfinqa/utils.py -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:38:47,410 copying lm_eval/tasks/jfinqa/test_jfinqa_utils.py -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:38:47,413 creating build/lib/lm_eval/tasks/bigbench 2026-09-01T00:38:47,413 copying lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:38:47,415 copying lm_eval/tasks/bigbench/utils.py -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:38:47,417 copying lm_eval/tasks/bigbench/generate_tasks.py -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:38:47,421 creating build/lib/lm_eval/tasks/blimp 2026-09-01T00:38:47,422 copying lm_eval/tasks/blimp/generate_configs.py -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:38:47,425 creating build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:38:47,426 copying lm_eval/tasks/nerel-bench/utils.py -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:38:47,430 creating build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:38:47,431 copying lm_eval/tasks/minerva_math/utils.py -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:38:47,434 creating build/lib/lm_eval/tasks/squadv2 2026-09-01T00:38:47,435 copying lm_eval/tasks/squadv2/task.py -> build/lib/lm_eval/tasks/squadv2 2026-09-01T00:38:47,438 creating build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:38:47,439 copying lm_eval/tasks/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:38:47,442 creating build/lib/lm_eval/tasks/medmcqa 2026-09-01T00:38:47,443 copying lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/lib/lm_eval/tasks/medmcqa 2026-09-01T00:38:47,446 creating build/lib/lm_eval/tasks/libra 2026-09-01T00:38:47,447 copying lm_eval/tasks/libra/utils.py -> build/lib/lm_eval/tasks/libra 2026-09-01T00:38:47,450 creating build/lib/lm_eval/tasks/winogrande 2026-09-01T00:38:47,451 copying lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/winogrande 2026-09-01T00:38:47,454 creating build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:38:47,454 copying lm_eval/tasks/arithmetic/utils.py -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:38:47,457 creating build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:47,459 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:47,462 creating build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:47,463 copying lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:47,467 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:38:47,469 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:38:47,471 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:38:47,472 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:38:47,475 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:38:47,476 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:38:47,478 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:38:47,479 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:38:47,481 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:47,482 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:47,485 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:38:47,486 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:38:47,488 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:38:47,490 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:38:47,492 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:47,493 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:47,496 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:38:47,497 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:38:47,500 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:47,501 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:47,503 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:38:47,504 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:38:47,506 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:38:47,508 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:38:47,510 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:38:47,511 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:38:47,513 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:38:47,514 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:38:47,517 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:38:47,518 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:38:47,521 creating build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:38:47,522 copying lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:38:47,528 creating build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:38:47,529 copying lm_eval/tasks/openai-mmmlu/default/utils.py -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:38:47,531 creating build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:38:47,533 copying lm_eval/tasks/tmlu/default/utils.py -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:38:47,535 copying lm_eval/tasks/tmlu/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:38:47,537 creating build/lib/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:38:47,538 copying lm_eval/tasks/eq_bench/multilingual/utils.py -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:38:47,541 creating build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:38:47,542 copying lm_eval/tasks/catalan_bench/cieacova/utils.py -> build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:38:47,545 creating build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:38:47,546 copying lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py -> build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:38:47,549 creating build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:38:47,550 copying lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:38:47,563 creating build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:38:47,565 copying lm_eval/tasks/click/click_lang/utils.py -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:38:47,568 creating build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:38:47,569 copying lm_eval/tasks/click/click_cul/utils.py -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:38:47,571 creating build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:38:47,573 copying lm_eval/tasks/hrm8k/en/utils.py -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:38:47,576 creating build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:38:47,577 copying lm_eval/tasks/hrm8k/default/utils.py -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:38:47,580 creating build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:38:47,582 copying lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:38:47,584 creating build/lib/lm_eval/tasks/noreval/norsumm 2026-09-01T00:38:47,585 copying lm_eval/tasks/noreval/norsumm/utils.py -> build/lib/lm_eval/tasks/noreval/norsumm 2026-09-01T00:38:47,589 creating build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:38:47,590 copying lm_eval/tasks/noreval/ask_gec/errant.py -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:38:47,593 creating build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:38:47,594 copying lm_eval/tasks/noreval/norquad/utils.py -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:38:47,597 creating build/lib/lm_eval/tasks/noreval/norec 2026-09-01T00:38:47,598 copying lm_eval/tasks/noreval/norec/utils.py -> build/lib/lm_eval/tasks/noreval/norec 2026-09-01T00:38:47,600 creating build/lib/lm_eval/tasks/noreval/noridiom 2026-09-01T00:38:47,601 copying lm_eval/tasks/noreval/noridiom/utils.py -> build/lib/lm_eval/tasks/noreval/noridiom 2026-09-01T00:38:47,606 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:38:47,608 copying lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:38:47,612 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:38:47,614 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:38:47,616 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:38:47,617 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:38:47,621 creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:38:47,623 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:38:47,625 creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:38:47,626 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:38:47,632 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:38:47,634 copying lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:38:47,636 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:38:47,637 copying lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:38:47,640 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:38:47,641 copying lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:38:47,643 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:38:47,644 copying lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:38:47,647 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:38:47,648 copying lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:38:47,650 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:38:47,652 copying lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:38:47,654 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:38:47,655 copying lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:38:47,658 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:38:47,659 copying lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:38:47,662 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:38:47,663 copying lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:38:47,665 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:38:47,666 copying lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:38:47,668 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:38:47,669 copying lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:38:47,672 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:38:47,673 copying lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:38:47,675 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:38:47,677 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:38:47,679 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:38:47,680 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:38:47,683 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:38:47,684 copying lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:38:47,689 creating build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:38:47,691 copying lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:38:47,693 copying lm_eval/tasks/code_x_glue/code-text/utils.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:38:47,695 creating build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:38:47,697 copying lm_eval/tasks/gpqa/zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:38:47,699 copying lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:38:47,701 creating build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:38:47,702 copying lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:38:47,705 copying lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:38:47,707 creating build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:38:47,708 copying lm_eval/tasks/gpqa/n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:38:47,710 copying lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:38:47,712 creating build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:38:47,713 copying lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:38:47,715 copying lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:38:47,718 creating build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:38:47,719 copying lm_eval/tasks/gpqa/generative/utils.py -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:38:47,721 copying lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:38:47,723 creating build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:38:47,724 copying lm_eval/tasks/mmlu_prox/id/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:38:47,727 creating build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:38:47,728 copying lm_eval/tasks/mmlu_prox/ar/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:38:47,730 creating build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:38:47,731 copying lm_eval/tasks/mmlu_prox/yo/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:38:47,734 creating build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:38:47,735 copying lm_eval/tasks/mmlu_prox/hi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:38:47,737 creating build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:38:47,738 copying lm_eval/tasks/mmlu_prox/de/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:38:47,740 creating build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:38:47,741 copying lm_eval/tasks/mmlu_prox/ja/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:38:47,744 creating build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:38:47,745 copying lm_eval/tasks/mmlu_prox/cs/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:38:47,747 creating build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:38:47,748 copying lm_eval/tasks/mmlu_prox/mr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:38:47,751 creating build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:38:47,752 copying lm_eval/tasks/mmlu_prox/es/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:38:47,754 creating build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:38:47,755 copying lm_eval/tasks/mmlu_prox/af/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:38:47,758 creating build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:38:47,759 copying lm_eval/tasks/mmlu_prox/vi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:38:47,762 creating build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:38:47,763 copying lm_eval/tasks/mmlu_prox/wo/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:38:47,765 creating build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:38:47,766 copying lm_eval/tasks/mmlu_prox/zh/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:38:47,769 creating build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:38:47,770 copying lm_eval/tasks/mmlu_prox/pt/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:38:47,772 creating build/lib/lm_eval/tasks/mmlu_prox/template 2026-09-01T00:38:47,773 copying lm_eval/tasks/mmlu_prox/template/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/template 2026-09-01T00:38:47,776 creating build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:38:47,777 copying lm_eval/tasks/mmlu_prox/uk/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:38:47,780 creating build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:38:47,781 copying lm_eval/tasks/mmlu_prox/te/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:38:47,783 creating build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:38:47,784 copying lm_eval/tasks/mmlu_prox/fr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:38:47,787 creating build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:38:47,788 copying lm_eval/tasks/mmlu_prox/en/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:38:47,790 creating build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:38:47,791 copying lm_eval/tasks/mmlu_prox/zu/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:38:47,794 creating build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:38:47,795 copying lm_eval/tasks/mmlu_prox/bn/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:38:47,798 creating build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:38:47,799 copying lm_eval/tasks/mmlu_prox/sw/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:38:47,801 creating build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:38:47,803 copying lm_eval/tasks/mmlu_prox/hu/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:38:47,805 creating build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:38:47,806 copying lm_eval/tasks/mmlu_prox/ur/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:38:47,809 creating build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:38:47,810 copying lm_eval/tasks/mmlu_prox/sr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:38:47,812 creating build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:38:47,813 copying lm_eval/tasks/mmlu_prox/ko/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:38:47,816 creating build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:38:47,817 copying lm_eval/tasks/mmlu_prox/ne/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:38:47,819 creating build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:38:47,820 copying lm_eval/tasks/mmlu_prox/it/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:38:47,823 creating build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:38:47,824 copying lm_eval/tasks/mmlu_prox/th/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:38:47,826 creating build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:38:47,827 copying lm_eval/tasks/mmlu_prox/ru/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:38:47,832 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:38:47,834 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:38:47,836 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:38:47,837 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:38:47,840 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:38:47,841 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:38:47,843 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:38:47,845 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:38:47,847 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:38:47,848 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:38:47,850 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:38:47,851 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:38:47,854 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:38:47,855 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:38:47,858 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:38:47,859 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:38:47,861 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:38:47,862 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:38:47,865 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:38:47,866 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:38:47,868 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:38:47,869 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:38:47,872 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:38:47,873 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:38:47,875 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:38:47,876 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:38:47,879 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:38:47,880 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:38:47,882 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:38:47,883 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:38:47,887 creating build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:38:47,889 copying lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:38:47,891 creating build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:38:47,892 copying lm_eval/tasks/global_mmlu/full/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:38:47,895 creating build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:38:47,897 copying lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:38:47,899 creating build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:38:47,900 copying lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:38:47,903 creating build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:38:47,904 copying lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:38:47,907 creating build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:38:47,908 copying lm_eval/tasks/global_mmlu/full/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:38:47,910 creating build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:38:47,911 copying lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:38:47,914 creating build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:38:47,915 copying lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:38:47,918 creating build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:38:47,919 copying lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:38:47,921 creating build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:38:47,923 copying lm_eval/tasks/global_mmlu/full/am/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:38:47,925 creating build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:38:47,926 copying lm_eval/tasks/global_mmlu/full/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:38:47,929 creating build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:38:47,930 copying lm_eval/tasks/global_mmlu/full/el/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:38:47,932 creating build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:38:47,933 copying lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:38:47,936 creating build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:38:47,937 copying lm_eval/tasks/global_mmlu/full/so/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:38:47,940 creating build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:38:47,941 copying lm_eval/tasks/global_mmlu/full/si/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:38:47,943 creating build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:38:47,944 copying lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:38:47,947 creating build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:38:47,948 copying lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:38:47,951 creating build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:38:47,952 copying lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:38:47,954 creating build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:38:47,955 copying lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:38:47,958 creating build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:38:47,959 copying lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:38:47,962 creating build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:38:47,963 copying lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:38:47,966 creating build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:38:47,967 copying lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:38:47,969 creating build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:38:47,971 copying lm_eval/tasks/global_mmlu/full/he/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:38:47,973 creating build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:38:47,975 copying lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:38:47,983 creating build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:38:47,984 copying lm_eval/tasks/global_mmlu/full/te/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:38:47,987 creating build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:38:47,988 copying lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:38:47,991 creating build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:38:47,992 copying lm_eval/tasks/global_mmlu/full/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:38:47,995 creating build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:38:47,996 copying lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:38:47,999 creating build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:38:48,000 copying lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:38:48,002 creating build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:38:48,003 copying lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:38:48,006 creating build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:38:48,007 copying lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:38:48,010 creating build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:38:48,010 copying lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:38:48,013 creating build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:38:48,014 copying lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:38:48,017 creating build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:38:48,018 copying lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:38:48,020 creating build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:38:48,021 copying lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:38:48,024 creating build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:38:48,025 copying lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:38:48,027 creating build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:38:48,028 copying lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:38:48,031 creating build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:38:48,032 copying lm_eval/tasks/global_mmlu/full/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:38:48,034 creating build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:38:48,035 copying lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:38:48,038 creating build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:38:48,039 copying lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:38:48,042 creating build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:38:48,043 copying lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:38:48,045 creating build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:38:48,047 copying lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:38:48,049 creating build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:38:48,051 copying lm_eval/tasks/global_mmlu/default/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:38:48,053 creating build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:38:48,054 copying lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:38:48,056 creating build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:38:48,057 copying lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:38:48,060 creating build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:38:48,061 copying lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:38:48,063 creating build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:38:48,064 copying lm_eval/tasks/global_mmlu/default/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:38:48,066 creating build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:38:48,067 copying lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:38:48,070 creating build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:38:48,071 copying lm_eval/tasks/global_mmlu/default/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:38:48,073 creating build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:38:48,074 copying lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:38:48,077 creating build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:38:48,078 copying lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:38:48,080 creating build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:38:48,081 copying lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:38:48,083 creating build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:38:48,084 copying lm_eval/tasks/global_mmlu/default/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:38:48,086 creating build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:38:48,087 copying lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:38:48,090 creating build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:38:48,091 copying lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:38:48,093 creating build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:38:48,094 copying lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:38:48,096 creating build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:38:48,097 copying lm_eval/tasks/global_mmlu/default/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:38:48,099 creating build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:38:48,101 copying lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:38:48,105 creating build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:38:48,107 copying lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:38:48,109 creating build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:38:48,110 copying lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:38:48,113 creating build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:38:48,114 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:38:48,116 creating build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:38:48,117 copying lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:38:48,120 creating build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:38:48,121 copying lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:38:48,124 creating build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:38:48,125 copying lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:38:48,127 creating build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:38:48,128 copying lm_eval/tasks/include/few_shot_en/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:38:48,131 creating build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:38:48,132 copying lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:38:48,134 creating build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:38:48,135 copying lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:38:48,138 creating build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:38:48,139 copying lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:38:48,142 creating build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:38:48,143 copying lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:38:48,145 creating build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:38:48,146 copying lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:38:48,149 creating build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:38:48,150 copying lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:38:48,152 creating build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:38:48,153 copying lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:38:48,156 creating build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:38:48,157 copying lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:38:48,159 creating build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:38:48,160 copying lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:38:48,163 creating build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:38:48,164 copying lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:38:48,166 creating build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:38:48,167 copying lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:38:48,170 creating build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:38:48,171 copying lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:38:48,173 creating build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:38:48,174 copying lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:38:48,177 creating build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:38:48,178 copying lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:38:48,180 creating build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:38:48,181 copying lm_eval/tasks/include/few_shot_en/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:38:48,184 creating build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:38:48,185 copying lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:38:48,187 creating build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:38:48,188 copying lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:38:48,190 creating build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:38:48,191 copying lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:38:48,194 creating build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:38:48,195 copying lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:38:48,197 creating build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:38:48,198 copying lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:38:48,201 creating build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:38:48,202 copying lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:38:48,204 creating build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:38:48,205 copying lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:38:48,207 creating build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:38:48,208 copying lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:38:48,211 creating build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:38:48,212 copying lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:38:48,214 creating build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:38:48,215 copying lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:38:48,217 creating build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:38:48,218 copying lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:38:48,221 creating build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:38:48,222 copying lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:38:48,224 creating build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:38:48,225 copying lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:38:48,227 creating build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:38:48,229 copying lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:38:48,231 creating build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:38:48,232 copying lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:38:48,234 creating build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:38:48,235 copying lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:38:48,238 creating build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:38:48,239 copying lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:38:48,241 creating build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:38:48,242 copying lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:38:48,245 creating build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:38:48,246 copying lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:38:48,248 creating build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:38:48,249 copying lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:38:48,252 creating build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:38:48,253 copying lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:38:48,255 creating build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:38:48,256 copying lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:38:48,259 creating build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:38:48,260 copying lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:38:48,263 creating build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:38:48,264 copying lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:38:48,266 creating build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:38:48,267 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:38:48,270 creating build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:38:48,271 copying lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:38:48,273 creating build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:38:48,274 copying lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:38:48,277 creating build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:38:48,278 copying lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:38:48,280 creating build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:38:48,281 copying lm_eval/tasks/include/few_shot_og/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:38:48,283 creating build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:38:48,285 copying lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:38:48,287 creating build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:38:48,288 copying lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:38:48,290 creating build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:38:48,291 copying lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:38:48,294 creating build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:38:48,295 copying lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:38:48,297 creating build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:38:48,298 copying lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:38:48,301 creating build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:38:48,302 copying lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:38:48,304 creating build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:38:48,306 copying lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:38:48,308 creating build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:38:48,309 copying lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:38:48,311 creating build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:38:48,312 copying lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:38:48,315 creating build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:38:48,316 copying lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:38:48,319 creating build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:38:48,320 copying lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:38:48,322 creating build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:38:48,323 copying lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:38:48,326 creating build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:38:48,327 copying lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:38:48,329 creating build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:38:48,330 copying lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:38:48,333 creating build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:38:48,334 copying lm_eval/tasks/include/few_shot_og/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:38:48,336 creating build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:38:48,337 copying lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:38:48,340 creating build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:38:48,340 copying lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:38:48,343 creating build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:38:48,344 copying lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:38:48,347 creating build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:38:48,348 copying lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:38:48,350 creating build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:38:48,351 copying lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:38:48,354 creating build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:38:48,355 copying lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:38:48,357 creating build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:38:48,358 copying lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:38:48,360 creating build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:38:48,361 copying lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:38:48,364 creating build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:38:48,365 copying lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:38:48,367 creating build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:38:48,368 copying lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:38:48,371 creating build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:38:48,372 copying lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:38:48,374 creating build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:38:48,376 copying lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:38:48,378 creating build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:38:48,379 copying lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:38:48,382 creating build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:38:48,383 copying lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:38:48,385 creating build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:38:48,386 copying lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:38:48,389 creating build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:38:48,390 copying lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:38:48,392 creating build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:38:48,393 copying lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:38:48,395 creating build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:38:48,396 copying lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:38:48,399 creating build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:38:48,400 copying lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:38:48,402 creating build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:38:48,403 copying lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:38:48,406 creating build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:38:48,407 copying lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:38:48,409 creating build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:38:48,410 copying lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:38:48,413 creating build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:38:48,415 copying lm_eval/tasks/include/default/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:38:48,417 creating build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:38:48,418 copying lm_eval/tasks/include/default/Hindi/utils.py -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:38:48,421 creating build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:38:48,422 copying lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:38:48,424 creating build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:38:48,425 copying lm_eval/tasks/include/default/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:38:48,428 creating build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:38:48,429 copying lm_eval/tasks/include/default/Dutch/utils.py -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:38:48,431 creating build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:38:48,432 copying lm_eval/tasks/include/default/Arabic/utils.py -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:38:48,435 creating build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:38:48,436 copying lm_eval/tasks/include/default/French/utils.py -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:38:48,438 creating build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:38:48,439 copying lm_eval/tasks/include/default/Nepali/utils.py -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:38:48,442 creating build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:38:48,443 copying lm_eval/tasks/include/default/Estonian/utils.py -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:38:48,445 creating build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:38:48,447 copying lm_eval/tasks/include/default/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:38:48,449 creating build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:38:48,450 copying lm_eval/tasks/include/default/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:38:48,453 creating build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:38:48,454 copying lm_eval/tasks/include/default/Finnish/utils.py -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:38:48,456 creating build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:38:48,458 copying lm_eval/tasks/include/default/Japanese/utils.py -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:38:48,460 creating build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:38:48,461 copying lm_eval/tasks/include/default/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:38:48,463 creating build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:38:48,464 copying lm_eval/tasks/include/default/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:38:48,467 creating build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:38:48,468 copying lm_eval/tasks/include/default/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:38:48,470 creating build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:38:48,471 copying lm_eval/tasks/include/default/Tamil/utils.py -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:38:48,474 creating build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:38:48,475 copying lm_eval/tasks/include/default/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:38:48,477 creating build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:38:48,478 copying lm_eval/tasks/include/default/Serbian/utils.py -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:38:48,480 creating build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:38:48,481 copying lm_eval/tasks/include/default/Albanian/utils.py -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:38:48,484 creating build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:38:48,485 copying lm_eval/tasks/include/default/Italian/utils.py -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:38:48,488 creating build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:38:48,489 copying lm_eval/tasks/include/default/German/utils.py -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:38:48,491 creating build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:38:48,492 copying lm_eval/tasks/include/default/Telugu/utils.py -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:38:48,495 creating build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:38:48,496 copying lm_eval/tasks/include/default/Bengali/utils.py -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:38:48,498 creating build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:38:48,499 copying lm_eval/tasks/include/default/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:38:48,502 creating build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:38:48,503 copying lm_eval/tasks/include/default/Persian/utils.py -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:38:48,506 creating build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:38:48,507 copying lm_eval/tasks/include/default/Armenian/utils.py -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:38:48,509 creating build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:38:48,510 copying lm_eval/tasks/include/default/Basque/utils.py -> build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:38:48,513 creating build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:38:48,514 copying lm_eval/tasks/include/default/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:38:48,516 creating build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:38:48,517 copying lm_eval/tasks/include/default/Greek/utils.py -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:38:48,520 creating build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:38:48,521 copying lm_eval/tasks/include/default/Chinese/utils.py -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:38:48,523 creating build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:38:48,525 copying lm_eval/tasks/include/default/Polish/utils.py -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:38:48,527 creating build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:38:48,528 copying lm_eval/tasks/include/default/Urdu/utils.py -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:38:48,531 creating build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:38:48,532 copying lm_eval/tasks/include/default/Spanish/utils.py -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:38:48,534 creating build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:38:48,535 copying lm_eval/tasks/include/default/Malay/utils.py -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:38:48,537 creating build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:38:48,538 copying lm_eval/tasks/include/default/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:38:48,540 creating build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:38:48,541 copying lm_eval/tasks/include/default/Croatian/utils.py -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:38:48,544 creating build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:38:48,545 copying lm_eval/tasks/include/default/Turkish/utils.py -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:38:48,547 creating build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:38:48,548 copying lm_eval/tasks/include/default/Korean/utils.py -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:38:48,551 creating build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:38:48,552 copying lm_eval/tasks/include/default/Georgian/utils.py -> build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:38:48,554 creating build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:38:48,555 copying lm_eval/tasks/include/default/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:38:48,558 creating build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:38:48,559 copying lm_eval/tasks/include/default/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:38:48,561 creating build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:38:48,562 copying lm_eval/tasks/include/default/Russian/utils.py -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:38:48,565 creating build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:38:48,566 copying lm_eval/tasks/include/default/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:38:48,568 creating build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:38:48,570 copying lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:38:48,572 creating build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:38:48,574 copying lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:38:48,576 creating build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:38:48,577 copying lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:38:48,580 creating build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:38:48,581 copying lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:38:48,584 creating build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:38:48,585 copying lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:38:48,588 creating build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:38:48,590 copying lm_eval/tasks/tmmluplus/default/utils.py -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:38:48,592 copying lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:38:48,596 creating build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:38:48,597 copying lm_eval/tasks/bbh/zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:38:48,600 creating build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:38:48,601 copying lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:38:48,606 creating build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:38:48,607 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:38:48,610 creating build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:38:48,611 copying lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:38:48,614 creating build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:38:48,616 copying lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:38:48,618 copying lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:38:48,620 creating build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:38:48,621 copying lm_eval/tasks/super_glue/cb/aggregate.py -> build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:38:48,623 copying lm_eval/tasks/super_glue/cb/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:38:48,626 creating build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:38:48,627 copying lm_eval/tasks/super_glue/record/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:38:48,629 copying lm_eval/tasks/super_glue/record/util.py -> build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:38:48,631 creating build/lib/lm_eval/tasks/super_glue/multirc 2026-09-01T00:38:48,633 copying lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/multirc 2026-09-01T00:38:48,635 creating build/lib/lm_eval/tasks/super_glue/copa 2026-09-01T00:38:48,636 copying lm_eval/tasks/super_glue/copa/utils.py -> build/lib/lm_eval/tasks/super_glue/copa 2026-09-01T00:38:48,639 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:38:48,641 copying lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:38:48,643 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:38:48,645 copying lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:38:48,647 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:38:48,648 copying lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:38:48,651 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:38:48,652 copying lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:38:48,654 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:38:48,655 copying lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:38:48,658 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:38:48,660 copying lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:38:48,662 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:38:48,663 copying lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:38:48,666 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:38:48,667 copying lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:38:48,670 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:38:48,670 copying lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:38:48,673 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:38:48,674 copying lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:38:48,676 creating build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:38:48,677 copying lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:38:48,680 creating build/lib/lm_eval/tasks/score/math 2026-09-01T00:38:48,681 copying lm_eval/tasks/score/math/math_grader.py -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:38:48,684 copying lm_eval/tasks/score/math/utils_math.py -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:38:48,687 creating build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:38:48,688 copying lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:38:48,691 creating build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:38:48,692 copying lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:38:48,696 creating build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:38:48,697 copying lm_eval/tasks/global_piqa/parallel_generation/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:38:48,700 creating build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:38:48,701 copying lm_eval/tasks/global_piqa/nonparallel_cloze/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:38:48,704 creating build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:38:48,705 copying lm_eval/tasks/global_piqa/parallel_cloze/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:38:48,708 creating build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:38:48,709 copying lm_eval/tasks/global_piqa/nonparallel_generation/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:38:48,712 creating build/lib/lm_eval/tasks/afrobench/adr 2026-09-01T00:38:48,714 copying lm_eval/tasks/afrobench/adr/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/adr 2026-09-01T00:38:48,717 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:38:48,718 copying lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:38:48,720 creating build/lib/lm_eval/tasks/afrobench/salt 2026-09-01T00:38:48,721 copying lm_eval/tasks/afrobench/salt/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/salt 2026-09-01T00:38:48,724 creating build/lib/lm_eval/tasks/afrobench/belebele 2026-09-01T00:38:48,726 copying lm_eval/tasks/afrobench/belebele/utils.py -> build/lib/lm_eval/tasks/afrobench/belebele 2026-09-01T00:38:48,728 creating build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:38:48,730 copying lm_eval/tasks/afrobench/masakhapos/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:38:48,732 copying lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:38:48,734 creating build/lib/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:38:48,736 copying lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:38:48,739 creating build/lib/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:38:48,740 copying lm_eval/tasks/afrobench/masakhanews/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:38:48,743 creating build/lib/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:38:48,744 copying lm_eval/tasks/afrobench/afriqa/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:38:48,746 creating build/lib/lm_eval/tasks/afrobench/mafand 2026-09-01T00:38:48,747 copying lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/mafand 2026-09-01T00:38:48,750 creating build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:38:48,751 copying lm_eval/tasks/afrobench/afrisenti/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:38:48,754 creating build/lib/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:38:48,755 copying lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:38:48,758 creating build/lib/lm_eval/tasks/afrobench/flores 2026-09-01T00:38:48,759 copying lm_eval/tasks/afrobench/flores/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/flores 2026-09-01T00:38:48,762 creating build/lib/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:38:48,763 copying lm_eval/tasks/afrobench/naijarc/utils.py -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:38:48,766 creating build/lib/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:38:48,767 copying lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:38:48,770 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:38:48,771 copying lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:38:48,773 creating build/lib/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:38:48,774 copying lm_eval/tasks/afrobench/xlsum/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:38:48,777 creating build/lib/lm_eval/tasks/afrobench/sib 2026-09-01T00:38:48,778 copying lm_eval/tasks/afrobench/sib/utils.py -> build/lib/lm_eval/tasks/afrobench/sib 2026-09-01T00:38:48,782 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:38:48,783 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:38:48,786 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:38:48,787 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:38:48,790 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:38:48,791 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:38:48,793 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:38:48,794 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:38:48,797 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:38:48,798 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:38:48,804 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:38:48,805 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:38:48,808 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:38:48,809 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:38:48,811 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:38:48,813 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:38:48,815 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:38:48,816 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:38:48,819 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:38:48,820 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:38:48,823 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:38:48,824 copying lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:38:48,826 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:38:48,827 copying lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:38:48,829 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:38:48,830 copying lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:38:48,833 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:38:48,834 copying lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:38:48,836 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:38:48,837 copying lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:38:48,840 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:38:48,840 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:38:48,843 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:38:48,844 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:38:48,846 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:38:48,847 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:38:48,850 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:38:48,851 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:38:48,854 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:38:48,855 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:38:48,857 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:38:48,859 copying lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:38:48,861 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:38:48,863 copying lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:38:48,865 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:38:48,866 copying lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:38:48,869 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:38:48,870 copying lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:38:48,872 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:38:48,874 copying lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:38:48,879 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:38:48,881 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:38:48,885 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:38:48,886 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:38:48,889 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:38:48,890 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:38:48,894 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:38:48,895 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:38:48,897 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:38:48,899 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:38:48,902 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:38:48,903 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:38:48,906 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:38:48,907 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:38:48,909 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:38:48,911 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:38:48,912 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:38:48,914 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:38:48,916 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:38:48,917 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:38:48,919 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:38:48,922 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:38:48,923 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:38:48,925 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:38:48,927 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:38:48,928 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:38:48,930 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:38:48,936 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:38:48,938 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:38:48,941 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:38:48,942 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:38:48,944 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:38:48,945 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:38:48,948 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:38:48,949 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:38:48,951 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:38:48,953 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:38:48,961 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:38:48,962 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:38:48,965 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:38:48,966 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:38:48,969 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:38:48,970 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:38:48,973 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:38:48,973 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:38:48,976 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:38:48,977 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:38:48,982 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:38:48,984 copying lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:38:48,986 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:38:48,988 copying lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:38:48,990 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:38:48,992 copying lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:38:48,994 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:38:48,996 copying lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:38:48,999 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:38:49,000 copying lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:38:49,003 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:38:49,004 copying lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:38:49,007 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:38:49,009 copying lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:38:49,011 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:38:49,013 copying lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:38:49,016 creating build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:38:49,017 copying lm_eval/tasks/mmlusr/answer_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:38:49,020 creating build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:38:49,021 copying lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:38:49,024 creating build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:38:49,025 copying lm_eval/tasks/mmlusr/question_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:38:49,028 creating build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:38:49,030 copying lm_eval/tasks/ifeval/multilingual/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:38:49,032 copying lm_eval/tasks/ifeval/multilingual/utils.py -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:38:49,035 creating build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:38:49,037 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:38:49,039 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:38:49,041 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:38:49,044 creating build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:38:49,046 copying lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:38:49,049 copying lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:38:49,054 copying lm_eval/tasks/ifeval/multilingual/instructions/__init__.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:38:49,056 creating build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:38:49,058 copying lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:38:49,061 creating build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:38:49,062 copying lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:38:49,065 creating build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:38:49,066 copying lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:38:49,069 creating build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:38:49,071 copying lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:38:49,075 creating build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:38:49,077 copying lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:38:49,080 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:38:49,082 copying lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:38:49,085 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:38:49,086 copying lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:38:49,090 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:38:49,091 copying lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:38:49,095 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:38:49,096 copying lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:38:49,099 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:38:49,100 copying lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:38:49,104 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:38:49,105 copying lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:38:49,109 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:38:49,110 copying lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:38:49,113 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:38:49,114 copying lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:38:49,117 creating build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:38:49,119 copying lm_eval/tasks/aradice/openbookqa/metrics.py -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:38:49,121 copying lm_eval/tasks/aradice/openbookqa/utils.py -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:38:49,124 creating build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:38:49,125 copying lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:38:49,127 creating build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:38:49,128 copying lm_eval/tasks/aradice/piqa/metrics.py -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:38:49,130 creating build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:38:49,131 copying lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:38:49,133 copying lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:38:49,136 creating build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:38:49,137 copying lm_eval/tasks/aradice/winogrande/metrics.py -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:38:49,139 copying lm_eval/tasks/aradice/winogrande/utils.py -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:38:49,141 creating build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:38:49,143 copying lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:38:49,145 copying lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:38:49,147 creating build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:38:49,148 copying lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:38:49,150 copying lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:38:49,153 creating build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:38:49,154 copying lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:38:49,156 copying lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:38:49,158 creating build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:38:49,159 copying lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:38:49,161 copying lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:38:49,164 creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:38:49,166 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:38:49,168 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:38:49,170 creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:38:49,171 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:38:49,173 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:38:49,176 creating build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:38:49,177 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:38:49,183 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:38:49,185 copying lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:38:49,188 creating build/lib/lm_eval/tasks/glue/mnli 2026-09-01T00:38:49,190 copying lm_eval/tasks/glue/mnli/utils.py -> build/lib/lm_eval/tasks/glue/mnli 2026-09-01T00:38:49,196 creating build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:38:49,198 copying lm_eval/tasks/e2lmc/noor/_generate_configs.py -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:38:49,201 creating build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:38:49,202 copying lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:38:49,204 creating build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:38:49,206 copying lm_eval/tasks/leaderboard/gpqa/utils.py -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:38:49,208 creating build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:38:49,209 copying lm_eval/tasks/leaderboard/math/utils.py -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:38:49,213 creating build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:38:49,214 copying lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:38:49,217 copying lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:38:49,219 copying lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:38:49,223 copying lm_eval/tasks/leaderboard/ifeval/utils.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:38:49,225 creating build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:38:49,227 copying lm_eval/tasks/leaderboard/musr/utils.py -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:38:49,229 creating build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:38:49,230 copying lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:38:49,244 running egg_info 2026-09-01T00:38:49,255 writing lm_eval.egg-info/PKG-INFO 2026-09-01T00:38:49,279 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2026-09-01T00:38:49,281 writing entry points to lm_eval.egg-info/entry_points.txt 2026-09-01T00:38:49,293 writing requirements to lm_eval.egg-info/requires.txt 2026-09-01T00:38:49,295 writing top-level names to lm_eval.egg-info/top_level.txt 2026-09-01T00:38:54,404 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:38:55,227 reading manifest template 'MANIFEST.in' 2026-09-01T00:38:55,228 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-09-01T00:38:55,230 adding license file 'LICENSE.md' 2026-09-01T00:38:56,199 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:38:59,542 copying lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:38:59,544 copying lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:38:59,547 copying lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:38:59,549 copying lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:38:59,551 copying lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:38:59,554 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:59,557 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:59,559 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:59,562 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:59,565 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:59,568 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:59,571 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:59,574 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:38:59,577 creating build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:38:59,578 copying lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:38:59,580 copying lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:38:59,583 copying lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:38:59,585 copying lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:38:59,587 copying lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:38:59,590 copying lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:38:59,592 copying lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:38:59,594 copying lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:59,597 copying lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:59,599 copying lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:59,601 copying lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:59,603 copying lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:59,606 copying lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:59,608 copying lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:59,610 copying lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:38:59,613 creating build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:38:59,614 copying lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:38:59,617 copying lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:38:59,619 copying lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:38:59,621 copying lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:38:59,624 copying lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:38:59,626 copying lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:38:59,628 copying lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:38:59,631 copying lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:38:59,633 copying lm_eval/tasks/mbpp/mbpp.yaml -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:38:59,636 copying lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:38:59,638 copying lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:38:59,640 copying lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:38:59,642 copying lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:38:59,645 copying lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:38:59,647 creating build/lib/lm_eval/tasks/siqa 2026-09-01T00:38:59,648 copying lm_eval/tasks/siqa/siqa.yaml -> build/lib/lm_eval/tasks/siqa 2026-09-01T00:38:59,651 copying lm_eval/tasks/c4/c4.yaml -> build/lib/lm_eval/tasks/c4 2026-09-01T00:38:59,653 creating build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,654 copying lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,657 copying lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,659 copying lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,662 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,664 copying lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,666 copying lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,668 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,670 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,673 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,675 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,677 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,679 copying lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,682 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,684 copying lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,686 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,689 copying lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,691 copying lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,693 copying lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,695 copying lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,698 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,700 copying lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,702 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,704 copying lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,707 copying lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,709 copying lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,711 copying lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,714 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,716 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,718 copying lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,720 copying lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,722 copying lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,725 copying lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,727 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,729 copying lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,731 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,733 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,736 copying lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,738 copying lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,740 copying lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,742 copying lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,744 copying lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,747 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,749 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,751 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,753 copying lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,756 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,758 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,760 copying lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,763 copying lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,766 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,768 copying lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,770 copying lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,773 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,775 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,777 copying lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,779 copying lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,781 copying lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,783 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:38:59,786 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:38:59,788 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:38:59,790 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:38:59,792 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:38:59,794 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:38:59,797 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:38:59,799 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:38:59,801 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:38:59,803 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:38:59,806 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,808 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,810 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,812 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,814 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,817 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,819 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,821 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,823 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,825 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:38:59,827 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:38:59,830 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:38:59,832 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:38:59,835 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:38:59,837 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,839 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,841 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,844 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,846 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,848 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,850 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,853 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,855 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,857 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,860 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,862 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,864 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,867 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,869 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,871 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,874 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,876 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,879 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,881 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,883 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,886 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,888 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,890 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,893 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,895 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,897 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,900 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,902 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,904 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,907 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,909 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,911 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,914 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,916 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,918 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,921 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,923 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,926 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,928 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,930 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,933 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,935 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,938 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,940 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,942 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,944 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,946 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,949 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,951 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,953 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,956 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,958 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,960 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,963 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,965 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,967 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,970 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:38:59,972 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:38:59,974 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:38:59,977 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,979 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,982 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,984 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,986 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,989 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,991 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,993 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,996 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:38:59,998 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,000 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,003 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,005 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,007 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,010 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,012 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,014 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,017 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,019 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,022 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,024 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,026 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,028 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,031 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,033 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,035 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,038 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,040 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,042 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,045 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,047 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,049 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,051 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,054 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,056 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,059 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,061 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,063 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,066 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,068 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,070 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,073 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,075 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,077 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,080 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,082 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,084 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,087 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,089 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,091 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,093 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,096 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,098 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,100 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,103 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,105 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,107 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,109 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,112 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:00,114 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:39:00,116 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:39:00,118 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:39:00,121 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:39:00,123 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:39:00,126 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:39:00,128 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:39:00,130 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:39:00,133 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:39:00,135 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:39:00,137 creating build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,138 copying lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,141 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,143 copying lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,145 copying lm_eval/tasks/blimp_nl/r_words__adverbial.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,147 copying lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,150 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,152 copying lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,154 copying lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,157 copying lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,159 copying lm_eval/tasks/blimp_nl/topicalization__island.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,161 copying lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,163 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,166 copying lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,168 copying lm_eval/tasks/blimp_nl/passive__impersonal.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,170 copying lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,172 copying lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,174 copying lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,177 copying lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,179 copying lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,181 copying lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,183 copying lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,185 copying lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,188 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,190 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,192 copying lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,194 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,196 copying lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,199 copying lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,201 copying lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,203 copying lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,206 copying lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,208 copying lm_eval/tasks/blimp_nl/complementive__position_verb.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,210 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,213 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,215 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,217 copying lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,220 copying lm_eval/tasks/blimp_nl/complementive__transitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,222 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,224 copying lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,226 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,228 copying lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,230 copying lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,232 copying lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,235 copying lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,237 copying lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,239 copying lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,241 copying lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,243 copying lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,245 copying lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,247 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,249 copying lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,251 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,253 copying lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,256 copying lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,258 copying lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,260 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,263 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,265 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,267 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,269 copying lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,271 copying lm_eval/tasks/blimp_nl/passive__aci.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,273 copying lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,275 copying lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,278 copying lm_eval/tasks/blimp_nl/relativization__island.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,280 copying lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,282 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,285 copying lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,287 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,289 copying lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,291 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,294 copying lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,296 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,298 copying lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,300 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,302 copying lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,304 copying lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,306 copying lm_eval/tasks/blimp_nl/verb_second__order_main.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,309 copying lm_eval/tasks/blimp_nl/complementive__intransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,311 copying lm_eval/tasks/blimp_nl/blimp_nl_group.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,313 copying lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,316 copying lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,318 copying lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,320 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,323 copying lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,325 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:00,327 creating build/lib/lm_eval/tasks/ulqa 2026-09-01T00:39:00,328 copying lm_eval/tasks/ulqa/lambada_uyghur.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:39:00,331 copying lm_eval/tasks/ulqa/celep1.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:39:00,333 copying lm_eval/tasks/ulqa/ulqa_.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:39:00,336 copying lm_eval/tasks/ulqa/uleval.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:39:00,338 copying lm_eval/tasks/ulqa/celep2.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:39:00,341 copying lm_eval/tasks/ulqa/ulqa.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:39:00,343 creating build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:00,344 copying lm_eval/tasks/ulqa/ulut/wag.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:00,346 copying lm_eval/tasks/ulqa/ulut/nug.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:00,348 copying lm_eval/tasks/ulqa/ulut/ulut.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:00,351 copying lm_eval/tasks/ulqa/ulut/wub.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:00,353 copying lm_eval/tasks/ulqa/ulut/wum.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:00,355 copying lm_eval/tasks/ulqa/ulut/wsm.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:00,358 copying lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:39:00,360 copying lm_eval/tasks/lingoly/lingoly_group.yaml -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:39:00,362 copying lm_eval/tasks/lingoly/lingoly_context.yaml -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:39:00,365 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,367 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,369 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,372 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,374 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,376 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,379 copying lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,381 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,383 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,385 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,387 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,390 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,392 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,394 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,397 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:00,399 copying lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:39:00,401 copying lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:39:00,404 copying lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,406 copying lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,408 copying lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,411 copying lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,413 copying lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,416 copying lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,418 copying lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,420 copying lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,422 copying lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,425 copying lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,427 copying lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,429 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,431 copying lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,434 copying lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,436 copying lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,439 copying lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,441 copying lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,443 copying lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,445 copying lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,447 copying lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,450 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,452 copying lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,455 copying lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,457 copying lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,460 copying lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,462 copying lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,464 copying lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,466 copying lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,469 copying lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,471 copying lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,473 copying lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,475 copying lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,478 copying lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,480 copying lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,482 copying lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,484 copying lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,487 copying lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,489 copying lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,491 copying lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,494 copying lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,496 copying lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,499 copying lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,501 copying lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,504 copying lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,506 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,509 copying lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,511 copying lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:00,513 copying lm_eval/tasks/aime/aime25.yaml -> build/lib/lm_eval/tasks/aime 2026-09-01T00:39:00,515 copying lm_eval/tasks/aime/aime24.yaml -> build/lib/lm_eval/tasks/aime 2026-09-01T00:39:00,518 copying lm_eval/tasks/aime/aime.yaml -> build/lib/lm_eval/tasks/aime 2026-09-01T00:39:00,520 copying lm_eval/tasks/icelandic_winogrande/default.yaml -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:39:00,522 copying lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/lib/lm_eval/tasks/wmt2016 2026-09-01T00:39:00,524 copying lm_eval/tasks/xcopa/default_sw.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,526 copying lm_eval/tasks/xcopa/default_th.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,528 copying lm_eval/tasks/xcopa/default_et.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,531 copying lm_eval/tasks/xcopa/default_ht.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,533 copying lm_eval/tasks/xcopa/default_qu.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,535 copying lm_eval/tasks/xcopa/default_vi.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,537 copying lm_eval/tasks/xcopa/default_it.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,539 copying lm_eval/tasks/xcopa/_xcopa.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,541 copying lm_eval/tasks/xcopa/default_tr.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,543 copying lm_eval/tasks/xcopa/default_zh.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,546 copying lm_eval/tasks/xcopa/default_id.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,548 copying lm_eval/tasks/xcopa/default_ta.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:00,550 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,552 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,554 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,556 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,559 copying lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,561 copying lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,563 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,565 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,568 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,570 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,572 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,574 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,576 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,579 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,581 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,583 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,585 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,588 copying lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,590 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,592 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,594 copying lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,596 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,599 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,601 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,603 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,605 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,607 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,610 copying lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,612 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,614 copying lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,616 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,618 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,621 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,623 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,625 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,627 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,630 copying lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,632 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,634 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,637 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,639 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,641 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,643 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,646 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,648 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,650 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,652 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,654 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,657 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,659 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,661 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,663 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,666 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,668 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,670 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,672 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,674 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,676 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,678 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,680 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,683 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,685 copying lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:00,687 copying lm_eval/tasks/cruxeval/cruxeval_input_08.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:39:00,689 copying lm_eval/tasks/cruxeval/cruxeval_output.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:39:00,692 copying lm_eval/tasks/cruxeval/cruxeval_input.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:39:00,694 copying lm_eval/tasks/cruxeval/cruxeval_output_08.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:39:00,696 copying lm_eval/tasks/cruxeval/cruxeval_input_cot.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:39:00,698 copying lm_eval/tasks/cruxeval/cruxeval_output_cot.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:39:00,701 copying lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:00,703 copying lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:00,706 copying lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:00,708 copying lm_eval/tasks/translation/wmt16_de-en.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:00,710 copying lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:00,712 copying lm_eval/tasks/translation/wmt16_en-de.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:00,715 copying lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:00,717 copying lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:00,719 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,722 copying lm_eval/tasks/galician_bench/galician_bench.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,724 copying lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,726 copying lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,729 copying lm_eval/tasks/galician_bench/galcola.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,731 copying lm_eval/tasks/galician_bench/paws_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,733 copying lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,735 copying lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,738 copying lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,740 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,743 copying lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,745 copying lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,747 copying lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:00,749 copying lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,752 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,754 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,756 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,758 copying lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,760 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,763 copying lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,765 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,767 copying lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,769 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,772 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,774 copying lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,776 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,778 copying lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,780 copying lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,783 copying lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,785 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:00,787 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_history_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,790 copying lm_eval/tasks/greekmmlu/greekmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,792 copying lm_eval/tasks/greekmmlu/greekmmlu_driving_rules.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,794 copying lm_eval/tasks/greekmmlu/greekmmlu_accounting.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,796 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_history_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,799 copying lm_eval/tasks/greekmmlu/greekmmlu_agriculture_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,801 copying lm_eval/tasks/greekmmlu/greekmmlu_prehistory.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,803 copying lm_eval/tasks/greekmmlu/greekmmlu_economics_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,806 copying lm_eval/tasks/greekmmlu/greekmmlu_world_religions.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,808 copying lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,810 copying lm_eval/tasks/greekmmlu/greekmmlu_world_history.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,812 copying lm_eval/tasks/greekmmlu/greekmmlu_management_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,815 copying lm_eval/tasks/greekmmlu/greekmmlu_maritime_safety_and_rescue_operations.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,818 copying lm_eval/tasks/greekmmlu/greekmmlu_mathematics.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,820 copying lm_eval/tasks/greekmmlu/greekmmlu_physics_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,822 copying lm_eval/tasks/greekmmlu/_greekmmlu_other.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,824 copying lm_eval/tasks/greekmmlu/greekmmlu_management_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,827 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_history_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,829 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_traditions.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,831 copying lm_eval/tasks/greekmmlu/greekmmlu_education_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,833 copying lm_eval/tasks/greekmmlu/greekmmlu_geography_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,836 copying lm_eval/tasks/greekmmlu/greekmmlu_geography_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,838 copying lm_eval/tasks/greekmmlu/greekmmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,840 copying lm_eval/tasks/greekmmlu/greekmmlu_art_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,842 copying lm_eval/tasks/greekmmlu/_greekmmlu_stem.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,845 copying lm_eval/tasks/greekmmlu/greekmmlu_computer_networks_and_security.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,847 copying lm_eval/tasks/greekmmlu/greekmmlu_medicine_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,849 copying lm_eval/tasks/greekmmlu/greekmmlu_physics_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,851 copying lm_eval/tasks/greekmmlu/greekmmlu_agriculture_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,854 copying lm_eval/tasks/greekmmlu/greekmmlu_computer_science_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,856 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_mythology.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,858 copying lm_eval/tasks/greekmmlu/greekmmlu_biology.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,860 copying lm_eval/tasks/greekmmlu/greekmmlu_chemistry.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,863 copying lm_eval/tasks/greekmmlu/greekmmlu_medicine_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,865 copying lm_eval/tasks/greekmmlu/_greekmmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,867 copying lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,870 copying lm_eval/tasks/greekmmlu/greekmmlu_art_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,872 copying lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,874 copying lm_eval/tasks/greekmmlu/greekmmlu_civil_engineering.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,877 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_literature.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,879 copying lm_eval/tasks/greekmmlu/greekmmlu_physics_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,882 copying lm_eval/tasks/greekmmlu/greekmmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,884 copying lm_eval/tasks/greekmmlu/greekmmlu_law.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,886 copying lm_eval/tasks/greekmmlu/greekmmlu_education_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,888 copying lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,890 copying lm_eval/tasks/greekmmlu/_greekmmlu_humanities.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,892 copying lm_eval/tasks/greekmmlu/greekmmlu_economics_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,894 copying lm_eval/tasks/greekmmlu/greekmmlu_art_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,897 copying lm_eval/tasks/greekmmlu/_greekmmlu.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,899 copying lm_eval/tasks/greekmmlu/greekmmlu_computer_science_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:00,901 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,903 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,905 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,907 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,910 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,912 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,914 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,916 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,918 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,920 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,922 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,924 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,926 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,929 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,931 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,933 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,935 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,937 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,939 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,942 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,944 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,946 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,948 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,951 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,953 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,955 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,957 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,959 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,961 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,963 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,966 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,968 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,970 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,972 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,974 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,977 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,979 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,981 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,983 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,986 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,988 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,990 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,992 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,995 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,997 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:00,999 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,002 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,004 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,007 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,009 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,011 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,013 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,016 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,018 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,020 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,022 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,024 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,027 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,029 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,031 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,033 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,036 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,038 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,040 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,043 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,045 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,047 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,049 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,052 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,054 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,056 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,059 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,061 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,063 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,065 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,068 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,070 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,073 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,075 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,077 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,079 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,081 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,083 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,086 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,088 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,090 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,092 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,094 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,097 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,099 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,101 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,103 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,105 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,107 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,110 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,112 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,114 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,116 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,118 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,120 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,123 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,125 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,127 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,129 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,132 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,134 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,136 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,138 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,140 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,142 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,144 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,147 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,149 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,151 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,153 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,155 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,157 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,159 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,161 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,164 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,166 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,168 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,171 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,173 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,175 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,178 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,180 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,182 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,185 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,187 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,189 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,191 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,194 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,196 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,198 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,200 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,202 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,204 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,206 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,208 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,211 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,213 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,215 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,217 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,219 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,221 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,223 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,226 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,228 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,230 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,232 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,234 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,236 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,238 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,240 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,242 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,245 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,247 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,249 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,251 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,253 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,255 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,257 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,259 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,261 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,263 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,266 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,268 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,270 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,272 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,274 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,277 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,279 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,281 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,283 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,285 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,287 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,289 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,292 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,294 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,296 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,298 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,300 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,302 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,305 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,307 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,309 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,311 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,313 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,315 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,317 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,319 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,321 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,323 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,326 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,328 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,330 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,332 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,334 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,337 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,339 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,341 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,343 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,345 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,347 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,350 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,352 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,354 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,356 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,358 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,360 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,362 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,364 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,367 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,369 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,372 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,374 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,376 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,378 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,380 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,382 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,384 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,386 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,389 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,391 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,393 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,395 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,397 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,399 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,401 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,403 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,406 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,408 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,410 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,413 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,415 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,418 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,420 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,423 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,425 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,428 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,430 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,433 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,435 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,437 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,440 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,443 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,445 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,448 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,450 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,452 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,454 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,456 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,458 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,460 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,463 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,465 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,467 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,469 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,471 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,473 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,475 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,478 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,480 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,482 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,484 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,486 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,488 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,490 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,492 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,494 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,496 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,499 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,501 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,503 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,505 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,507 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,509 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,511 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,514 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,516 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,518 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,520 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,522 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,525 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,527 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,529 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,531 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,533 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,536 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,538 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,540 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,542 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,545 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,547 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,549 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,551 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,553 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,555 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,557 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,559 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,562 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,564 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,566 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,568 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,570 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,572 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,575 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,577 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,579 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,581 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,583 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,585 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,588 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,590 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,592 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,594 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,596 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,598 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,601 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,603 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,605 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,607 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,610 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,612 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,614 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,617 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,619 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,621 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,623 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,625 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,627 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,630 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,632 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,634 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,636 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,638 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,641 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,643 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,645 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,647 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,650 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,652 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,654 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,657 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,659 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,661 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,664 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,666 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,668 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,670 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,673 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,675 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,677 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,679 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,681 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,683 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,686 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,688 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,690 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,692 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,695 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,697 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,700 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,702 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,704 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,706 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,708 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,710 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,713 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,715 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,717 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,719 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,722 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,724 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,726 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,729 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,731 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,733 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,735 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,737 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,740 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,742 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,744 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,746 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,748 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,751 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,753 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,755 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,757 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,759 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,761 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,764 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,766 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,768 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,770 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,772 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,774 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,777 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,779 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,782 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,784 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,786 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,789 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,791 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,793 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,795 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,797 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,799 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,802 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,804 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,806 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,809 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,811 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,813 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,815 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,817 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,820 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,822 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,824 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,826 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,828 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,830 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,832 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,835 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,837 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,839 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,841 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,843 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,846 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,848 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,850 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,852 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,854 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,856 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,858 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,860 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,862 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,864 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,866 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,868 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,870 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,873 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,875 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,877 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,879 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,881 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,883 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,885 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,887 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,889 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,891 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,894 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,896 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,898 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,900 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,903 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,905 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,907 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,909 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,911 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,913 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,916 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,918 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,920 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,923 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,925 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,927 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,929 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,931 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,933 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,936 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,938 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,940 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,942 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,944 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,946 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,949 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,951 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,953 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,955 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,958 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,960 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,962 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,964 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,966 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,968 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,970 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,972 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,974 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,977 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,979 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,981 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,983 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,985 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,987 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,989 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,991 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,993 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,996 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:01,998 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,000 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,002 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,004 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,006 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,008 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,011 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,013 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,015 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,017 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,019 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,021 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,023 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,025 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,027 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,029 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,031 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,033 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,036 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,038 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,040 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,042 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,044 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,047 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,049 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,051 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,053 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,056 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,058 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,060 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,062 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,064 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,066 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,069 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,071 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,073 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,075 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,077 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,079 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,081 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,084 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,086 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,088 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,090 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,092 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,095 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,097 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,099 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,101 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,103 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,106 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,108 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,110 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,113 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,115 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,117 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,119 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,122 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,124 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,126 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,128 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,131 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,133 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,135 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,137 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,140 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,142 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,144 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,146 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,148 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,150 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,153 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,155 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,157 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,159 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,161 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,164 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,166 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,168 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,170 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,173 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,175 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,177 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,179 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,181 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,183 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,185 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,188 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,190 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,192 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,194 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,196 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,198 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,200 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,202 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,204 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,206 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,208 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,210 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,212 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,214 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,217 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,219 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,221 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,223 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,225 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,227 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,229 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,231 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,234 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,236 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,238 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,240 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,242 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,244 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,246 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,248 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,250 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,252 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,254 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,257 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,259 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,261 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,263 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,265 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,267 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,269 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,271 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,274 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,276 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,278 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,280 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,282 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,284 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,286 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,289 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,291 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,293 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,295 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,297 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,299 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,301 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,304 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,306 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,308 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,310 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,312 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,314 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,316 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,318 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,320 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,322 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,324 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,326 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,329 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,331 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,333 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,335 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,337 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,339 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,342 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,344 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,346 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,348 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,350 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,352 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,354 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,356 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,359 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,361 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,363 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,365 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,367 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,370 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,372 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,374 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,376 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,378 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,380 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,382 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,384 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,386 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,389 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,391 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,393 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,395 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,397 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,399 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,402 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,404 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,406 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,408 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,410 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,413 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,415 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,417 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,419 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,421 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,424 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,426 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,428 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,430 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,432 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,434 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,436 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,439 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,441 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,443 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,445 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,447 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,450 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,452 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,454 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,456 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,459 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,461 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,463 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,466 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,468 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,470 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,473 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,475 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,477 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,479 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,482 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,484 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,486 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,488 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,491 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,493 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,495 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,497 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,499 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,501 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,504 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,506 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,508 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,510 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,512 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,514 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,517 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,519 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,521 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,523 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,525 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,527 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,530 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,532 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,534 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,536 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,539 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,541 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,543 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,545 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,547 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,549 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,552 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,554 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,556 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,558 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,560 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,562 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,564 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,567 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,569 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,571 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,573 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,575 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,577 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,579 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,582 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,584 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,586 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,588 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,590 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,593 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,595 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,597 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,599 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,601 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,603 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,605 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,607 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,609 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,611 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,613 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,616 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,618 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,620 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,622 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,625 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,627 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,629 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,631 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,633 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,635 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,637 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,640 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,642 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,644 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,646 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,648 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,650 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,652 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,654 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,656 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,658 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,661 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,663 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,665 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,667 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,669 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,671 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,673 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,675 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,677 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,679 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,681 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,683 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,685 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,687 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,690 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,692 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,694 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,696 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,698 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,700 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,702 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,704 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,706 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,708 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,710 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,713 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,715 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,717 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,719 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,721 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,723 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,725 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,727 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,729 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,731 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,733 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,735 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,737 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,739 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,742 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,744 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,746 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,748 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,750 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,752 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,754 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,757 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,759 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,761 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,764 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,766 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,768 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,770 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,773 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,775 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,777 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,779 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,781 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,783 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,785 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,787 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,789 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:02,791 copying lm_eval/tasks/ruler/niah_single_3.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,793 copying lm_eval/tasks/ruler/niah_multivalue.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,796 copying lm_eval/tasks/ruler/cwe.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,798 copying lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,800 copying lm_eval/tasks/ruler/vt.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,802 copying lm_eval/tasks/ruler/qa_squad.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,804 copying lm_eval/tasks/ruler/qa_hotpot.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,806 copying lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,809 copying lm_eval/tasks/ruler/fwe.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,811 copying lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,813 copying lm_eval/tasks/ruler/niah_single_1.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,815 copying lm_eval/tasks/ruler/niah_multiquery.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,818 copying lm_eval/tasks/ruler/ruler.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,820 copying lm_eval/tasks/ruler/niah_single_2.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:02,822 creating build/lib/lm_eval/tasks/openbookqa 2026-09-01T00:39:02,823 copying lm_eval/tasks/openbookqa/openbookqa.yaml -> build/lib/lm_eval/tasks/openbookqa 2026-09-01T00:39:02,825 creating build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,826 copying lm_eval/tasks/turblimp/island_effects.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,829 copying lm_eval/tasks/turblimp/binding.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,831 copying lm_eval/tasks/turblimp/passives.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,833 copying lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,835 copying lm_eval/tasks/turblimp/nominalization.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,837 copying lm_eval/tasks/turblimp/npi_licensing.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,840 copying lm_eval/tasks/turblimp/subject_agreement.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,842 copying lm_eval/tasks/turblimp/relative_clauses.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,844 copying lm_eval/tasks/turblimp/scrambling.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,846 copying lm_eval/tasks/turblimp/ellipsis.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,848 copying lm_eval/tasks/turblimp/suspended_affixation.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,850 copying lm_eval/tasks/turblimp/anaphor_agreement.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,852 copying lm_eval/tasks/turblimp/argument_structure_transitive.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,855 copying lm_eval/tasks/turblimp/quantifiers.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,857 copying lm_eval/tasks/turblimp/irregular_forms.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,859 copying lm_eval/tasks/turblimp/turblimp_group.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,861 copying lm_eval/tasks/turblimp/determiners.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:02,863 copying lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,865 copying lm_eval/tasks/cabbq/cabbq_disability_status.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,867 copying lm_eval/tasks/cabbq/cabbq_ses.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,869 copying lm_eval/tasks/cabbq/cabbq_spanish_region.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,871 copying lm_eval/tasks/cabbq/cabbq_gender.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,873 copying lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,875 copying lm_eval/tasks/cabbq/cabbq_nationality.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,877 copying lm_eval/tasks/cabbq/cabbq_religion.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,879 copying lm_eval/tasks/cabbq/cabbq.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,881 copying lm_eval/tasks/cabbq/cabbq_age.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,883 copying lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:02,885 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,888 copying lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,890 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,892 copying lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,894 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,896 copying lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,899 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,901 copying lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,904 copying lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,906 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,908 copying lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,910 copying lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,912 copying lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,914 copying lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,916 copying lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,918 copying lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,920 copying lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,922 copying lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,925 copying lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,927 copying lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,929 copying lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,931 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,932 copying lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,934 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,937 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,938 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,940 copying lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,943 copying lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,945 copying lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,947 copying lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,949 copying lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,951 copying lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:02,953 copying lm_eval/tasks/eq_bench/default.yaml -> build/lib/lm_eval/tasks/eq_bench 2026-09-01T00:39:02,955 copying lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:39:02,958 copying lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:39:02,960 copying lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,962 copying lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,964 copying lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,966 copying lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,969 copying lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,971 copying lm_eval/tasks/catalan_bench/teca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,973 copying lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,975 copying lm_eval/tasks/catalan_bench/catcola.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,977 copying lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,980 copying lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,982 copying lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,984 copying lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,986 copying lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,988 copying lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,991 copying lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,993 copying lm_eval/tasks/catalan_bench/coqcat.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,995 copying lm_eval/tasks/catalan_bench/xnli_va.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,997 copying lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:02,999 copying lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:03,002 copying lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:03,004 copying lm_eval/tasks/catalan_bench/terretaqa.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:03,006 copying lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:03,008 copying lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:03,010 copying lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:03,012 copying lm_eval/tasks/catalan_bench/cieacova/cieacova.yaml -> build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:39:03,014 copying lm_eval/tasks/catalan_bench/cieacova/cieacova_choice.yaml -> build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:39:03,017 copying lm_eval/tasks/catalan_bench/cieacova/cieacova_word.yaml -> build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:39:03,019 copying lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml -> build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:39:03,021 copying lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,023 copying lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,026 copying lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,028 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,030 copying lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,032 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,034 copying lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,036 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,039 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,041 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,043 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,045 copying lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,047 copying lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,050 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,052 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,054 copying lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,057 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:03,059 creating build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:39:03,060 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:39:03,062 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:39:03,064 copying lm_eval/tasks/babilong/babilong.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,067 copying lm_eval/tasks/babilong/babilong_qa11.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,069 copying lm_eval/tasks/babilong/babilong_qa7.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,071 copying lm_eval/tasks/babilong/babilong_qa16.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,074 copying lm_eval/tasks/babilong/babilong_qa15.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,076 copying lm_eval/tasks/babilong/babilong_longctx.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,078 copying lm_eval/tasks/babilong/babilong_qa13.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,080 copying lm_eval/tasks/babilong/babilong_qa3.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,082 copying lm_eval/tasks/babilong/babilong_qa12.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,084 copying lm_eval/tasks/babilong/babilong_qa20.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,086 copying lm_eval/tasks/babilong/babilong_qa8.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,088 copying lm_eval/tasks/babilong/babilong_qa19.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,091 copying lm_eval/tasks/babilong/babilong_qa10.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,093 copying lm_eval/tasks/babilong/babilong_qa18.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,095 copying lm_eval/tasks/babilong/babilong_qa5.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,097 copying lm_eval/tasks/babilong/babilong_qa4.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,099 copying lm_eval/tasks/babilong/babilong_qa6.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,102 copying lm_eval/tasks/babilong/babilong_qa9.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,104 copying lm_eval/tasks/babilong/babilong_qa17.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,106 copying lm_eval/tasks/babilong/babilong_qa2.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,108 copying lm_eval/tasks/babilong/babilong_qa1.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,110 copying lm_eval/tasks/babilong/babilong_qa14.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:03,112 creating build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:03,113 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:03,116 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:03,118 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:03,120 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:03,122 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:03,124 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:03,126 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:03,128 copying lm_eval/tasks/csatqa/_csatqa.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:39:03,130 copying lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:39:03,132 copying lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:39:03,134 copying lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:39:03,136 copying lm_eval/tasks/csatqa/csatqa_li.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:39:03,138 copying lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:39:03,140 copying lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:39:03,142 creating build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,143 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,145 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,147 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,149 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,151 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,154 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,156 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,158 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,160 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,162 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,164 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:03,167 creating build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,168 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,170 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,172 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,174 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,177 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,179 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,181 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,183 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,185 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,188 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,190 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:03,192 creating build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,193 copying lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,196 copying lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,198 copying lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,200 copying lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,202 copying lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,204 copying lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,206 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,208 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,210 copying lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,212 copying lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,214 copying lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:03,216 copying lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:39:03,218 copying lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:39:03,220 copying lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:39:03,222 copying lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:39:03,224 copying lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,226 copying lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,228 copying lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,230 copying lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,232 copying lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,234 copying lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,237 copying lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,239 copying lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,241 copying lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,243 copying lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,245 copying lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,247 copying lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,250 copying lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,252 copying lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,254 copying lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,256 copying lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,258 copying lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,260 copying lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,262 copying lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,264 copying lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,266 copying lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,268 copying lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,271 copying lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,272 copying lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,274 copying lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,277 copying lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,279 copying lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,281 copying lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,283 copying lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,285 copying lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,287 copying lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,289 copying lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,291 copying lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,293 copying lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,295 copying lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,297 copying lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,299 copying lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,301 copying lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,303 copying lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,305 copying lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,307 copying lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,309 copying lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,312 copying lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,314 copying lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,316 copying lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,318 copying lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,320 copying lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,322 copying lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,324 copying lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,326 copying lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,328 copying lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,330 copying lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,332 copying lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,334 copying lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,336 copying lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,339 copying lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,341 copying lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,343 copying lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,345 copying lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,347 copying lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,350 copying lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,352 copying lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,354 copying lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,356 copying lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,358 copying lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,360 copying lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,362 copying lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,364 copying lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,366 copying lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,368 copying lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,370 copying lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,372 copying lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,374 copying lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,377 copying lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,379 copying lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,381 copying lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,383 copying lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,385 copying lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,387 copying lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,389 copying lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,391 copying lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,393 copying lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,395 copying lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,397 copying lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,399 copying lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,401 copying lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,403 copying lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,405 copying lm_eval/tasks/belebele/_belebele.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,408 copying lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,410 copying lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,412 copying lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,414 copying lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,416 copying lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,419 copying lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,421 copying lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,423 copying lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,425 copying lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,427 copying lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,429 copying lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,431 copying lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,433 copying lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,435 copying lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,438 copying lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,440 copying lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,442 copying lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,444 copying lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,446 copying lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,448 copying lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,450 copying lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,453 copying lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,455 copying lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,457 copying lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,459 copying lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,461 copying lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,463 copying lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,465 copying lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,467 copying lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,469 copying lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,472 copying lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,474 copying lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,476 copying lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,478 copying lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,480 copying lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:03,482 copying lm_eval/tasks/paws-x/paws_de.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:03,485 copying lm_eval/tasks/paws-x/_pawsx.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:03,487 copying lm_eval/tasks/paws-x/paws_ja.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:03,489 copying lm_eval/tasks/paws-x/paws_es.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:03,491 copying lm_eval/tasks/paws-x/paws_ko.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:03,493 copying lm_eval/tasks/paws-x/paws_en.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:03,495 copying lm_eval/tasks/paws-x/paws_zh.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:03,497 copying lm_eval/tasks/paws-x/paws_fr.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:03,499 copying lm_eval/tasks/copal_id/standard.yaml -> build/lib/lm_eval/tasks/copal_id 2026-09-01T00:39:03,502 copying lm_eval/tasks/copal_id/colloquial.yaml -> build/lib/lm_eval/tasks/copal_id 2026-09-01T00:39:03,503 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot 2026-09-01T00:39:03,504 copying lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot 2026-09-01T00:39:03,507 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,507 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,510 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,512 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,514 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,516 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,518 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,520 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,522 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,525 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,527 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,529 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,531 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,533 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,535 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,537 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,539 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,541 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,543 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,546 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:03,548 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,549 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,551 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,553 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,555 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,557 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,560 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,562 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,564 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,566 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,568 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,570 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,572 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,574 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,576 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,578 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,580 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,582 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,584 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,587 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:03,589 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,590 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,592 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,594 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,596 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,599 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,601 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,603 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,605 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,607 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,609 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,612 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,614 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,616 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,618 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,620 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,622 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,624 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,626 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,628 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:03,630 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,631 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,634 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,636 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,638 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,640 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,642 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,644 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,647 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,649 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,651 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,653 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,655 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,657 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,660 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,662 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,664 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,666 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,669 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,671 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:03,673 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,674 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,676 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,678 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,680 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,682 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,684 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,687 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,689 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,691 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,693 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,695 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,697 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,699 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,701 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,703 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,705 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,708 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,710 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,712 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:03,714 creating build/lib/lm_eval/tasks/afrimgsm/translate 2026-09-01T00:39:03,716 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2026-09-01T00:39:03,718 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,719 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,721 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,723 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,725 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,728 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,730 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,732 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,734 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,736 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,738 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,741 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,743 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,745 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,747 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,749 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,752 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,754 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:03,756 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,757 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,759 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,761 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,763 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,766 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,768 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,770 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,772 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,774 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,777 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,779 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,781 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,783 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,785 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,787 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,790 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,792 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:03,794 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,795 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,797 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,799 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,801 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,803 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,805 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,808 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,810 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,812 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,814 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,817 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,819 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,821 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,823 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,825 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,828 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,830 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:03,832 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,833 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,836 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,838 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,840 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,842 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,844 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,847 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,849 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,851 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,853 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,855 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,858 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,860 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,862 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,864 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,866 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,869 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:03,871 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,872 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,874 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,877 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,879 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,881 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,883 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,885 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,888 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,890 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,892 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,894 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,896 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,899 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,901 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,903 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,905 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,907 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:03,909 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot 2026-09-01T00:39:03,910 copying lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot 2026-09-01T00:39:03,913 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,914 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,916 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,918 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,920 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,923 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,925 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,927 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,929 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,931 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,934 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,936 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,938 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,941 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,943 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,945 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,948 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,950 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,952 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:03,954 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,955 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,957 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,959 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,962 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,964 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,966 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,968 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,971 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,973 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,975 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,977 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,979 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,981 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,983 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,986 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,988 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,990 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,992 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:03,994 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:03,995 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:03,997 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:03,999 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,001 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,003 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,005 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,007 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,009 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,011 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,013 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,015 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,017 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,019 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,022 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,024 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,026 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,028 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,031 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:04,033 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,034 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,036 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,039 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,041 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,043 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,045 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,047 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,049 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,051 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,053 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,055 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,057 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,059 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,062 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,064 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,066 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,068 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,070 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:04,073 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,074 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,076 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,078 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,081 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,083 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,085 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,087 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,089 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,091 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,094 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,096 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,098 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,101 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,103 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,105 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,108 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,110 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,112 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:04,114 creating build/lib/lm_eval/tasks/afrimgsm/direct 2026-09-01T00:39:04,115 copying lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2026-09-01T00:39:04,117 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,118 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,120 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,122 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,125 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,127 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,129 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,131 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,133 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,135 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,137 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,139 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,142 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,144 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,146 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,148 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,150 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,152 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,154 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,157 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:04,159 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,160 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,162 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,164 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,167 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,169 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,171 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,173 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,175 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,177 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,179 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,181 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,183 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,185 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,188 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,190 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,192 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,194 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,196 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,199 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:04,201 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,201 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,204 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,206 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,208 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,211 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,213 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,215 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,217 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,219 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,221 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,224 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,226 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,228 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,230 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,232 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,234 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,236 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,238 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,240 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:04,243 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,244 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,246 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,248 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,250 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,252 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,254 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,257 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,259 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,261 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,263 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,265 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,267 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,269 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,272 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,274 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,276 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,278 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,281 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,283 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:04,285 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,286 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,288 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,291 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,293 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,295 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,297 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,299 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,301 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,303 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,305 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,307 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,310 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,312 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,314 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,316 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,318 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,320 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,322 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,324 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:04,326 copying lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,328 copying lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,330 copying lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,332 copying lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,334 copying lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,336 copying lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,338 copying lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,341 copying lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,343 copying lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,345 copying lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,347 copying lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,350 copying lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,352 copying lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,354 copying lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,356 copying lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,358 copying lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,360 copying lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,362 copying lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,364 copying lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,367 copying lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,369 copying lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,370 copying lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,372 copying lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,375 copying lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,377 copying lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,379 copying lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,381 copying lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,383 copying lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,385 copying lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,387 copying lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,389 copying lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,391 copying lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,393 copying lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,396 copying lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,398 copying lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,400 copying lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,402 copying lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,404 copying lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,406 copying lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,408 copying lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,410 copying lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,412 copying lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,414 copying lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,416 copying lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,419 copying lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,421 copying lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,423 copying lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,425 copying lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,427 copying lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:04,429 copying lm_eval/tasks/pisa/pisa_es.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,431 copying lm_eval/tasks/pisa/pisa_fr.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,433 copying lm_eval/tasks/pisa/pisa_it.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,435 copying lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,438 copying lm_eval/tasks/pisa/pisa_de.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,440 copying lm_eval/tasks/pisa/pisa_en_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,442 copying lm_eval/tasks/pisa/pisa_es_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,444 copying lm_eval/tasks/pisa/_pisa_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,446 copying lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,448 copying lm_eval/tasks/pisa/pisa_en.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,450 copying lm_eval/tasks/pisa/_pisa.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,452 copying lm_eval/tasks/pisa/pisa_ch.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,454 copying lm_eval/tasks/pisa/pisa_it_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,456 copying lm_eval/tasks/pisa/pisa_de_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:04,459 copying lm_eval/tasks/click/click.yaml -> build/lib/lm_eval/tasks/click 2026-09-01T00:39:04,461 copying lm_eval/tasks/click/click_lang/click_lang_grammar.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:39:04,463 copying lm_eval/tasks/click/click_lang/click_lang_function.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:39:04,465 copying lm_eval/tasks/click/click_lang/click_lang_text.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:39:04,467 copying lm_eval/tasks/click/click_lang/_click_lang.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:39:04,469 copying lm_eval/tasks/click/click_cul/click_cul_law.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,471 copying lm_eval/tasks/click/click_cul/click_cul_kpop.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,473 copying lm_eval/tasks/click/click_cul/click_cul_society.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,475 copying lm_eval/tasks/click/click_cul/click_cul_politics.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,477 copying lm_eval/tasks/click/click_cul/click_cul_economy.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,479 copying lm_eval/tasks/click/click_cul/click_cul_history.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,481 copying lm_eval/tasks/click/click_cul/click_cul_tradition.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,483 copying lm_eval/tasks/click/click_cul/_click_cul.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,486 copying lm_eval/tasks/click/click_cul/click_cul_geography.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:04,488 copying lm_eval/tasks/winogender/winogender.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:39:04,490 copying lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:39:04,492 copying lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:39:04,494 copying lm_eval/tasks/winogender/winogender_female.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:39:04,496 copying lm_eval/tasks/winogender/winogender_neutral.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:39:04,498 copying lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:39:04,500 copying lm_eval/tasks/winogender/winogender_male.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:39:04,503 copying lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/lib/lm_eval/tasks/med_prescriptions 2026-09-01T00:39:04,505 copying lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/lib/lm_eval/tasks/med_prescriptions 2026-09-01T00:39:04,507 copying lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:39:04,509 copying lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:39:04,511 copying lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:39:04,514 copying lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:39:04,516 copying lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:39:04,518 copying lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:39:04,520 copying lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:39:04,522 copying lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:39:04,524 copying lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:39:04,526 copying lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:39:04,528 copying lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:39:04,530 copying lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:39:04,532 creating build/lib/lm_eval/tasks/indicxnli 2026-09-01T00:39:04,533 copying lm_eval/tasks/indicxnli/indicxnli_gu.yaml -> build/lib/lm_eval/tasks/indicxnli 2026-09-01T00:39:04,536 creating build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,537 copying lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,539 copying lm_eval/tasks/xstorycloze/default_ru.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,541 copying lm_eval/tasks/xstorycloze/default_en.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,543 copying lm_eval/tasks/xstorycloze/default_hi.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,546 copying lm_eval/tasks/xstorycloze/default_sw.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,548 copying lm_eval/tasks/xstorycloze/default_ar.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,550 copying lm_eval/tasks/xstorycloze/default_my.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,552 copying lm_eval/tasks/xstorycloze/default_te.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,554 copying lm_eval/tasks/xstorycloze/default_es.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,557 copying lm_eval/tasks/xstorycloze/default_eu.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,559 copying lm_eval/tasks/xstorycloze/default_zh.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,561 copying lm_eval/tasks/xstorycloze/default_id.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:04,564 copying lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/lib/lm_eval/tasks/groundcocoa 2026-09-01T00:39:04,566 creating build/lib/lm_eval/tasks/noreval/norrewrite-instruct 2026-09-01T00:39:04,567 copying lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norrewrite-instruct 2026-09-01T00:39:04,569 creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:04,570 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:04,572 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:04,574 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:04,577 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:04,579 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:04,581 creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:04,582 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:04,584 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:04,586 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:04,589 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:04,591 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:04,593 creating build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:04,594 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:04,596 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:04,598 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:04,600 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:04,602 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:04,604 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:04,606 creating build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:04,608 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:04,610 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:04,612 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:04,614 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:04,616 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:04,619 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:04,621 creating build/lib/lm_eval/tasks/noreval/ncb 2026-09-01T00:39:04,622 copying lm_eval/tasks/noreval/ncb/ncb.yaml -> build/lib/lm_eval/tasks/noreval/ncb 2026-09-01T00:39:04,624 creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:04,626 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:04,629 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:04,631 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:04,634 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:04,636 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:04,638 creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:04,639 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:04,642 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:04,644 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:04,646 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:04,649 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:04,651 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:04,652 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:04,654 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:04,656 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:04,658 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:04,660 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:04,662 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:04,663 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:04,667 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:04,669 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:04,672 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:04,674 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:04,676 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:04,679 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:04,681 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:04,683 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:04,685 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:04,688 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:04,690 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:04,692 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:04,695 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:04,697 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:04,699 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:04,701 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:04,703 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:04,705 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:04,707 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:04,710 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:04,711 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:04,713 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:04,716 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:04,718 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:04,720 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:04,721 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:04,723 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:04,726 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:04,728 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:04,730 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:04,731 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:04,733 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:04,736 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:04,738 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:04,740 creating build/lib/lm_eval/tasks/noreval/norsummarize-instruct 2026-09-01T00:39:04,741 copying lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norsummarize-instruct 2026-09-01T00:39:04,743 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:04,746 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:04,748 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:04,751 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:04,753 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:04,755 creating build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:04,756 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:04,759 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:04,761 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:04,763 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:04,765 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:04,767 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:04,769 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:04,772 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:04,774 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:04,776 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:04,778 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:04,781 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:04,783 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:04,785 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:04,787 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:04,789 copying lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:39:04,792 copying lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:39:04,794 copying lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:39:04,796 copying lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:39:04,798 copying lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:39:04,801 creating build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:04,802 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:04,804 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:04,806 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:04,809 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:04,811 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:04,813 creating build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:04,814 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:04,816 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:04,819 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:04,821 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:04,823 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:04,825 creating build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:04,826 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:04,829 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:04,831 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:04,833 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:04,835 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:04,838 creating build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:04,839 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:04,841 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:04,844 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:04,846 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:04,848 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:04,850 copying lm_eval/tasks/fda/fda.yaml -> build/lib/lm_eval/tasks/fda 2026-09-01T00:39:04,852 creating build/lib/lm_eval/tasks/bear 2026-09-01T00:39:04,853 copying lm_eval/tasks/bear/bear_big.yaml -> build/lib/lm_eval/tasks/bear 2026-09-01T00:39:04,856 copying lm_eval/tasks/bear/bear.yaml -> build/lib/lm_eval/tasks/bear 2026-09-01T00:39:04,858 creating build/lib/lm_eval/tasks/lambada_cloze 2026-09-01T00:39:04,859 copying lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2026-09-01T00:39:04,862 copying lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2026-09-01T00:39:04,864 creating build/lib/lm_eval/tasks/babi 2026-09-01T00:39:04,865 copying lm_eval/tasks/babi/babi.yaml -> build/lib/lm_eval/tasks/babi 2026-09-01T00:39:04,867 creating build/lib/lm_eval/tasks/mastermind 2026-09-01T00:39:04,868 copying lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:39:04,871 copying lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:39:04,873 copying lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:39:04,875 copying lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:39:04,877 copying lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:39:04,880 copying lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:39:04,882 copying lm_eval/tasks/xquad/xquad_th.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,884 copying lm_eval/tasks/xquad/xquad_ru.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,886 copying lm_eval/tasks/xquad/xquad_de.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,889 copying lm_eval/tasks/xquad/xquad_ar.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,891 copying lm_eval/tasks/xquad/xquad_vi.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,893 copying lm_eval/tasks/xquad/xquad_ro.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,895 copying lm_eval/tasks/xquad/xquad_zh.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,897 copying lm_eval/tasks/xquad/xquad_en.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,899 copying lm_eval/tasks/xquad/xquad_el.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,902 copying lm_eval/tasks/xquad/xquad_tr.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,904 copying lm_eval/tasks/xquad/xquad_es.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,906 copying lm_eval/tasks/xquad/xquad_hi.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:04,909 copying lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/lib/lm_eval/tasks/afrixnli/translate 2026-09-01T00:39:04,911 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,913 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,916 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,918 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,920 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,922 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,925 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,927 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,929 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,931 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,934 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,936 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,939 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,941 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,943 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,946 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,948 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:04,950 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,953 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,955 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,957 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,960 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,962 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,964 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,966 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,969 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,971 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,973 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,976 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,978 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,980 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,982 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,984 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,986 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:04,989 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:04,991 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:04,993 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:04,995 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:04,998 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,000 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,002 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,004 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,006 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,009 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,011 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,013 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,016 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,018 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,020 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,022 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,024 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:05,026 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,029 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,031 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,033 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,035 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,038 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,040 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,042 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,044 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,047 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,049 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,051 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,053 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,056 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,058 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,060 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,062 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:05,065 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,067 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,069 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,071 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,074 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,076 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,078 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,080 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,082 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,084 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,086 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,089 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,091 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,093 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,095 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,097 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,100 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:05,102 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,104 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,107 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,109 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,111 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,113 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,116 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,118 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,120 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,123 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,125 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,127 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,129 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,131 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,133 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,135 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,138 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:05,140 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,142 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,144 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,146 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,148 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,150 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,153 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,155 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,157 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,159 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,161 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,164 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,166 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,168 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,170 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,172 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,174 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,177 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:05,179 copying lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/lib/lm_eval/tasks/afrixnli/direct 2026-09-01T00:39:05,182 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,184 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,186 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,188 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,190 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,192 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,194 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,197 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,199 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,201 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,203 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,205 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,208 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,210 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,212 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,215 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,217 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,219 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:05,221 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,224 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,226 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,228 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,230 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,232 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,235 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,237 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,239 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,241 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,243 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,246 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,248 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,250 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,252 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,255 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,257 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,259 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:05,261 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,263 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,265 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,267 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,269 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,272 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,274 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,276 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,278 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,281 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,283 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,285 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,288 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,290 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,293 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,295 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,298 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,300 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:05,302 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,305 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,307 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,309 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,312 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,314 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,316 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,318 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,320 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,322 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,325 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,327 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,329 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,331 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,333 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,335 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,337 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,339 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:05,342 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,344 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,346 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,348 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,351 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,353 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,355 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,357 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,359 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,361 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,363 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,366 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,368 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,370 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,372 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,375 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,377 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,379 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:05,381 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,383 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,386 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,388 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,390 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,392 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,394 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,396 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,398 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,401 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,403 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,405 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,407 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,410 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,412 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,414 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,416 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,419 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:05,421 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,423 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,425 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,428 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,430 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,432 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,434 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,436 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,438 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,441 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,443 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,445 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,447 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,449 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,451 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,453 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,455 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,457 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:05,459 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,462 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,464 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,466 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,468 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,470 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,473 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,475 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,477 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,479 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,481 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,483 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,485 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,487 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,489 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,491 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,493 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:05,495 copying lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,497 copying lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,499 copying lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,501 copying lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,503 copying lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,505 copying lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,508 copying lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,510 copying lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,512 copying lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,514 copying lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,516 copying lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,518 copying lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,520 copying lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,523 copying lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,525 copying lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,527 copying lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,529 copying lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,532 copying lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:05,534 copying lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/lib/lm_eval/tasks/pubmedqa 2026-09-01T00:39:05,536 creating build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,537 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,540 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,542 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,544 copying lm_eval/tasks/lm_syneval/lm_syneval_group.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,547 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,549 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,551 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,553 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,556 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,558 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,560 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,562 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,564 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,566 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,569 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,571 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,573 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,575 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,577 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,579 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,581 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,583 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,585 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,587 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,590 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,592 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,594 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,596 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,598 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,600 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,602 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,604 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,606 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,608 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,610 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,612 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,614 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,616 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,618 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,620 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,622 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,624 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,626 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,628 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,630 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,632 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,634 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,637 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,639 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,642 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,644 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,646 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,648 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,651 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,653 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,655 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,658 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,660 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,662 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,664 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,666 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,668 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,670 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,672 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,674 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,676 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,679 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,681 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,683 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,685 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,687 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,689 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,692 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:05,694 copying lm_eval/tasks/agieval/logiqa-en.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,696 copying lm_eval/tasks/agieval/sat-en.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,698 copying lm_eval/tasks/agieval/agieval_nous.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,700 copying lm_eval/tasks/agieval/agieval.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,702 copying lm_eval/tasks/agieval/lsat-ar.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,704 copying lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,707 copying lm_eval/tasks/agieval/aqua-rat.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,709 copying lm_eval/tasks/agieval/math.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,711 copying lm_eval/tasks/agieval/agieval_cn.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,713 copying lm_eval/tasks/agieval/gaokao-biology.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,715 copying lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,718 copying lm_eval/tasks/agieval/lsat-rc.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,720 copying lm_eval/tasks/agieval/gaokao-physics.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,722 copying lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,724 copying lm_eval/tasks/agieval/gaokao-geography.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,726 copying lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,728 copying lm_eval/tasks/agieval/agieval_en.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,731 copying lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,733 copying lm_eval/tasks/agieval/logiqa-zh.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,735 copying lm_eval/tasks/agieval/gaokao-english.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,737 copying lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,739 copying lm_eval/tasks/agieval/sat-math.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,742 copying lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,744 copying lm_eval/tasks/agieval/gaokao-history.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,746 copying lm_eval/tasks/agieval/lsat-lr.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:05,748 creating build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,749 copying lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,752 copying lm_eval/tasks/zhoblimp/verb_negation_particle.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,754 copying lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,756 copying lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,758 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,760 copying lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,762 copying lm_eval/tasks/zhoblimp/topicalization_SOV.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,765 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,767 copying lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,769 copying lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,771 copying lm_eval/tasks/zhoblimp/PN_numP_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,773 copying lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,775 copying lm_eval/tasks/zhoblimp/you_yige.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,778 copying lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,780 copying lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,782 copying lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,784 copying lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,786 copying lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,789 copying lm_eval/tasks/zhoblimp/question_particle_nandao.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,791 copying lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,793 copying lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,795 copying lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,797 copying lm_eval/tasks/zhoblimp/left_adverbial_e.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,799 copying lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,801 copying lm_eval/tasks/zhoblimp/agent_causative.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,803 copying lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,805 copying lm_eval/tasks/zhoblimp/BEI_construction_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,807 copying lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,809 copying lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,811 copying lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,813 copying lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,815 copying lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,817 copying lm_eval/tasks/zhoblimp/BA_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,819 copying lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,821 copying lm_eval/tasks/zhoblimp/BA_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,824 copying lm_eval/tasks/zhoblimp/causative_shi_ba.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,826 copying lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,828 copying lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,830 copying lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,832 copying lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,834 copying lm_eval/tasks/zhoblimp/agent_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,836 copying lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,838 copying lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,840 copying lm_eval/tasks/zhoblimp/BEI_construction_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,843 copying lm_eval/tasks/zhoblimp/ellipsis_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,845 copying lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,847 copying lm_eval/tasks/zhoblimp/passive_intransitive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,849 copying lm_eval/tasks/zhoblimp/ya_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,851 copying lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,853 copying lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,856 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,858 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,860 copying lm_eval/tasks/zhoblimp/BA_no_progressive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,862 copying lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,864 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,866 copying lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,868 copying lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,870 copying lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,872 copying lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,874 copying lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,876 copying lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,879 copying lm_eval/tasks/zhoblimp/passive_suo.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,881 copying lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,883 copying lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,885 copying lm_eval/tasks/zhoblimp/modal_raising_hui.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,887 copying lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,890 copying lm_eval/tasks/zhoblimp/BA_inversion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,892 copying lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,894 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,896 copying lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,899 copying lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,901 copying lm_eval/tasks/zhoblimp/topicalization_OSV.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,903 copying lm_eval/tasks/zhoblimp/right_yijing_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,905 copying lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,907 copying lm_eval/tasks/zhoblimp/BA_meiba.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,910 copying lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,912 copying lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,914 copying lm_eval/tasks/zhoblimp/question_daodi_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,916 copying lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,918 copying lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,921 copying lm_eval/tasks/zhoblimp/right_yijing_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,923 copying lm_eval/tasks/zhoblimp/principle_A_domain.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,925 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,927 copying lm_eval/tasks/zhoblimp/BEI_preposition.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,929 copying lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,932 copying lm_eval/tasks/zhoblimp/question_nandao_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,934 copying lm_eval/tasks/zhoblimp/BEI_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,936 copying lm_eval/tasks/zhoblimp/PN_numP_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,938 copying lm_eval/tasks/zhoblimp/relative_operator_who.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,940 copying lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,942 copying lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,944 copying lm_eval/tasks/zhoblimp/passive_no_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,946 copying lm_eval/tasks/zhoblimp/passive_body_part.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,948 copying lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,950 copying lm_eval/tasks/zhoblimp/left_adverbial_d.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,952 copying lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,954 copying lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,956 copying lm_eval/tasks/zhoblimp/zhoblimp_group.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,959 copying lm_eval/tasks/zhoblimp/preposition_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,961 copying lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,963 copying lm_eval/tasks/zhoblimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,966 copying lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,968 copying lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,970 copying lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,972 copying lm_eval/tasks/zhoblimp/left_dou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,974 copying lm_eval/tasks/zhoblimp/preposition_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,976 copying lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,978 copying lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,981 copying lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,983 copying lm_eval/tasks/zhoblimp/question_A_not_A.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,985 copying lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,987 copying lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,989 copying lm_eval/tasks/zhoblimp/nominal_definite_men.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,992 copying lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,994 copying lm_eval/tasks/zhoblimp/left_adverbial_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,996 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:05,998 copying lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:06,000 copying lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:06,003 copying lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:06,005 copying lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:39:06,007 copying lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:39:06,009 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,012 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,014 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,016 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,018 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,020 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,022 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,024 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,026 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,028 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,031 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,033 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,035 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,037 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,039 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,042 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,044 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,046 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,048 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,050 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,052 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:06,054 creating build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,055 copying lm_eval/tasks/bhs/bhs_basque.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,058 copying lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,060 copying lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,062 copying lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,064 copying lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,066 copying lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,069 copying lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,071 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,073 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,075 copying lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,077 copying lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,079 copying lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,081 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,083 copying lm_eval/tasks/bhs/bhs_hindi.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,085 copying lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,087 copying lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,089 copying lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,092 copying lm_eval/tasks/bhs/hindi-S_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,093 copying lm_eval/tasks/bhs/bhs_swahili.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,096 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,098 copying lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,100 copying lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,102 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,104 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,106 copying lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:06,108 copying lm_eval/tasks/toksuite/_toksuite_all.yaml -> build/lib/lm_eval/tasks/toksuite 2026-09-01T00:39:06,110 copying lm_eval/tasks/toksuite/_toksuite_abridged.yaml -> build/lib/lm_eval/tasks/toksuite 2026-09-01T00:39:06,112 creating build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,113 copying lm_eval/tasks/toksuite/toksuite_chinese/_toksuite_chinese.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,116 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_romanization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,118 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,120 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_equivalent_expressions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,123 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,125 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_partially_romanized.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,127 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,129 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_traditional.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,132 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_ocr_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,134 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,136 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,138 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_space_removal.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,141 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_optional_diacritics.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,143 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_word_spacing_zero-width_characters_extra_space.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,145 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_code_language_script_switching.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:06,148 creating build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,149 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,151 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,153 copying lm_eval/tasks/toksuite/toksuite_turkish/_toksuite_turkish.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,155 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_code_language_script_switching.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,157 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_dialects.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,159 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_derivations.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,162 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_inflections.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,164 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_similar_words.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,166 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,168 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_orthographic_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,170 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_english_keyboard.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,172 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_web_search_query.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,174 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,177 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_typographical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,179 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_equivalent_expressions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,181 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,183 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_date_formats.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,186 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_grammatical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,188 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_word_reordering.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:06,190 creating build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,191 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spaced_styling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,194 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_macron_diacritic.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,196 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_lowercase.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,198 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_emoji_substitution.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,200 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_deletion.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,202 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_space_removal.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,205 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_word_reordering.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,207 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_substitution.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,209 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,211 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_date_formats.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,217 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_capitalization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,219 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_contractions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,222 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_ocr_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,224 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,226 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,229 copying lm_eval/tasks/toksuite/toksuite_english/_toksuite_english.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,232 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_web_search_query.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,234 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_scripted_text.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,237 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_grammatical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,240 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_letter_repetition_for_emphasis.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,242 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_historical_spelling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,245 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_inflections.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,247 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_similar_words.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,250 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_hyphenated_spelling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,253 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_homoglyphs.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,255 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,258 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_compounds.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,260 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_superscript_subscript_styling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,263 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_abbreviations.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,265 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_orthographic_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,268 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:06,270 creating build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,272 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_romanization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,274 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,277 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,279 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,282 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,284 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_word_spacing_zero-width_characters_extra_space.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,287 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_code_language_script_switching.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,289 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_dialects.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,292 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_number_romanization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,294 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,297 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_optional_diacritics.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,299 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_arabic_keyboard_for_farsi.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,302 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_equivalent_expressions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,304 copying lm_eval/tasks/toksuite/toksuite_farsi/_toksuite_farsi.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:06,306 creating build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,308 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_latex.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,311 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,313 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_farsi.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,316 copying lm_eval/tasks/toksuite/toksuite_math/_toksuite_math.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,318 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_turkish.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,321 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,324 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_space_removal.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,326 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_decorative_unicode.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,329 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_italian.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,332 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_chinese.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,334 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:06,336 creating build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,338 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,340 copying lm_eval/tasks/toksuite/toksuite_italian/_toksuite_italian.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,343 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_capitalization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,345 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_code_language_script_switching.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,348 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_plausible_diacritics_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,350 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_numerical_formats.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,352 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_phonetic_spelling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,355 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_similar_words.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,358 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_contractions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,360 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,363 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_date_formats.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,365 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_grammatical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,368 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_orthographic_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,370 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_dialects.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,373 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_web_search_query.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,375 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_english_keyboard.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,378 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_typographical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,380 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,382 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,385 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_abbreviations.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:06,387 creating build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,389 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_diacriticized_styling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,391 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_latex.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,394 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_upside_down_rotated.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,396 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,399 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_enclosed_characters.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,401 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,403 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_double_struck.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,406 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unusual_formatting.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,408 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,410 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_strikethrough.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,413 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_morpheme_separation.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,415 copying lm_eval/tasks/toksuite/toksuite_stem/_toksuite_stem.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,418 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_space_removal.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,421 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_fullwidth_characters.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,423 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_superscript_subscript.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,426 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unicode_formatting.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,428 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_typographical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,430 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_character_deletion.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,433 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_equivalent_expressions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,435 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_scripted_text.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,438 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:06,441 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,443 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,446 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,449 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,451 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,454 copying lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,457 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,460 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,462 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,465 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,467 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,470 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,472 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,475 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,477 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,480 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,482 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,485 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,487 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,490 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,493 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,495 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,498 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,501 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,503 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,506 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,509 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,511 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,514 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,516 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,519 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,521 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,524 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,527 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,529 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,532 copying lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,534 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,537 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,540 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,542 copying lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,545 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,547 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,550 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,552 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,555 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,558 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,560 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,563 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,565 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,568 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,570 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,573 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,575 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,578 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,580 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,583 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,585 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,587 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,590 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,592 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,595 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,598 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,600 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,603 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,605 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,608 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,610 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,613 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,615 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,618 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,620 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,623 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,626 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:06,629 copying lm_eval/tasks/infinitebench/infinitebench_math_find.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,632 copying lm_eval/tasks/infinitebench/infinitebench_longbook_qa_en.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,635 copying lm_eval/tasks/infinitebench/infinitebench_longbook_sum_en.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,638 copying lm_eval/tasks/infinitebench/infinitebench_code_debug.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,641 copying lm_eval/tasks/infinitebench/infinitebench_longbook_choice_en.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,644 copying lm_eval/tasks/infinitebench/infinitebench_kv_retrieval.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,647 copying lm_eval/tasks/infinitebench/infinitebench_passkey.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,650 copying lm_eval/tasks/infinitebench/infinitebench_longbook_qa_chn.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,653 copying lm_eval/tasks/infinitebench/infinitebench_code_run.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,656 copying lm_eval/tasks/infinitebench/infinitebench.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,659 copying lm_eval/tasks/infinitebench/infinitebench_number_string.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,662 copying lm_eval/tasks/infinitebench/infinitebench_longdialogue_qa_en.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:06,665 copying lm_eval/tasks/wsc273/default.yaml -> build/lib/lm_eval/tasks/wsc273 2026-09-01T00:39:06,668 copying lm_eval/tasks/logiqa/logiqa.yaml -> build/lib/lm_eval/tasks/logiqa 2026-09-01T00:39:06,671 copying lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:06,674 copying lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:06,678 copying lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:06,681 copying lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:06,684 copying lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:06,687 copying lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:06,690 copying lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:06,693 copying lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/lib/lm_eval/tasks/histoires_morales 2026-09-01T00:39:06,696 copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:39:06,699 copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:39:06,702 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,705 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,708 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,711 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,714 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,717 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,720 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,724 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,727 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,729 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,731 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,734 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,736 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,738 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,741 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:06,743 copying lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:06,745 copying lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:06,748 copying lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:06,750 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:06,753 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:06,755 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:06,757 copying lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:06,760 copying lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:06,762 copying lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:06,765 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:06,767 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:06,770 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:06,772 copying lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:39:06,774 copying lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:39:06,777 copying lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:39:06,779 copying lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:39:06,782 copying lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:39:06,784 copying lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:39:06,787 copying lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:39:06,789 copying lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:39:06,791 copying lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:39:06,794 copying lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:39:06,796 copying lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,799 copying lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,801 copying lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,804 copying lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,806 copying lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,808 copying lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,810 copying lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,813 copying lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,815 copying lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:06,818 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,820 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,822 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,824 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,827 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,829 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,832 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,834 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,836 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,839 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,841 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,843 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,846 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,848 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,850 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,853 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,855 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,858 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,860 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,862 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,865 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,868 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,870 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,873 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,875 copying lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,877 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,880 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,882 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,885 copying lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,888 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:06,890 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,893 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,895 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,897 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,900 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,903 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,905 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,908 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,910 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,912 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,915 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,917 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,919 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,922 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,924 copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,927 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,929 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,931 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,933 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,936 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,938 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,940 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,942 copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,944 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,946 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,948 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,950 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,952 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,954 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,956 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:06,958 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,960 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,962 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,964 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,967 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,968 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,971 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,973 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,975 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,977 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,979 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,981 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,983 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,985 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,987 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,989 copying lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,992 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,994 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,996 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:06,998 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,000 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,002 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,004 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,007 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,009 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,011 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,013 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,015 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,018 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,020 copying lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:07,022 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,024 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,026 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,028 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,030 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,032 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,034 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,036 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,038 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,040 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,042 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,045 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,047 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,049 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,051 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,053 copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,055 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,057 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,060 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,062 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,064 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,066 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,068 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,070 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,073 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,075 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,077 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,080 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,082 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,084 copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:07,086 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,088 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,090 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,092 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,094 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,096 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,098 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,100 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,103 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,105 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,107 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,109 copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,111 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,114 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,116 copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,118 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,120 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,123 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,125 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,127 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,130 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,132 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,134 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,136 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,138 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,141 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,143 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,145 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,147 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,150 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:07,152 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,154 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,156 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,158 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,160 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,163 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,165 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,167 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,169 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,172 copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,174 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,176 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,178 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,180 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,182 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,184 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,187 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,189 copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,191 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,193 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,196 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,198 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,200 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,202 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,204 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,207 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,209 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,211 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,213 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,216 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:07,218 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,220 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,222 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,224 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,226 copying lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,228 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,231 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,233 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,235 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,237 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,239 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,241 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,243 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,246 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,248 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,250 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,253 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,255 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,257 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,260 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,262 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,265 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,267 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,269 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,272 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,274 copying lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,276 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,279 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,281 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,283 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:07,286 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,288 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,290 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,293 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,295 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,297 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,300 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,302 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,304 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,306 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,309 copying lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,311 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,313 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,315 copying lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,318 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,320 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,322 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,324 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,327 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,329 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,331 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,333 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,336 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,338 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,340 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,342 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,345 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,347 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,349 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,351 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:07,354 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,356 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,358 copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,361 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,363 copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,365 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,367 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,369 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,371 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,373 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,375 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,378 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,380 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,382 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,384 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,386 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,389 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,391 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,393 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,395 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,397 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,400 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,402 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,404 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,406 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,409 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,411 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,413 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,416 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,418 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:07,420 copying lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,422 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,425 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,427 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,430 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,432 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,435 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,438 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,440 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,443 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,446 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,449 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,451 copying lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,454 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,457 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,460 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,462 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,465 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,468 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,471 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,474 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,477 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,480 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,482 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,485 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,488 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,491 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,494 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,497 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,499 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:07,502 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,505 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,507 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,510 copying lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,513 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,516 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,518 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,521 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,524 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,526 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,529 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,531 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,534 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,536 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,538 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,540 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,542 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,544 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,546 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,548 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,551 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,553 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,555 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,557 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,560 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,562 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,564 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,566 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,569 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,571 copying lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:07,573 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,576 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,578 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,580 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,582 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,585 copying lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,587 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,589 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,592 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,594 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,596 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,598 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,600 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,602 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,605 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,607 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,609 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,612 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,614 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,617 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,619 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,621 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,623 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,625 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,628 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,630 copying lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,632 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,634 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,637 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,639 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:07,641 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,644 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,646 copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,649 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,651 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,654 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,656 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,659 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,661 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,663 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,666 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,668 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,670 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,672 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,675 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,677 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,679 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,681 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,684 copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,686 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,688 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,690 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,693 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,695 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,698 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,700 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,703 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,705 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,707 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,709 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:07,711 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,714 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,716 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,718 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,721 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,723 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,725 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,728 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,730 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,733 copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,735 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,738 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,740 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,742 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,744 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,746 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,749 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,751 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,753 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,756 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,758 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,760 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,763 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,765 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,767 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,769 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,772 copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,774 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,776 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,778 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:07,781 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,783 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,786 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,788 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,790 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,793 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,795 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,797 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,800 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,802 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,804 copying lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,807 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,809 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,811 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,813 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,816 copying lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,818 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,820 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,822 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,825 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,827 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,829 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,831 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,834 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,836 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,838 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,840 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,843 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,845 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,847 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:07,850 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,852 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,855 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,857 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,859 copying lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,861 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,864 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,866 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,869 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,871 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,873 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,876 copying lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,878 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,881 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,883 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,886 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,888 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,890 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,892 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,894 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,897 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,899 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,901 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,903 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,906 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,908 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,910 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,913 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,915 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,918 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:07,920 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,922 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,925 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,927 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,929 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,932 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,934 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,937 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,939 copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,941 copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,944 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,946 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,948 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,950 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,953 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,955 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,957 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,959 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,962 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,964 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,966 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,968 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,970 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,972 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,974 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,976 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,979 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,981 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,983 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,985 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:07,987 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:07,989 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:07,991 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:07,994 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:07,996 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:07,998 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,000 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,002 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,005 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,007 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,009 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,012 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,014 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,016 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,019 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,021 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,024 copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,027 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,029 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,031 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,033 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,036 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,038 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,041 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,043 copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,046 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,048 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,050 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,053 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,055 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:08,057 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,060 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,062 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,064 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,067 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,070 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,072 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,074 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,077 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,079 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,082 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,084 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,086 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,089 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,091 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,093 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,096 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,098 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,101 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,103 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,105 copying lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,107 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,109 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,112 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,114 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,116 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,118 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,121 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,123 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,125 copying lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:08,127 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,129 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,131 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,134 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,136 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,138 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,140 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,143 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,145 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,147 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,150 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,152 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,154 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,157 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,159 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,161 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,163 copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,166 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,168 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,171 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,173 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,175 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,177 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,179 copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,182 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,184 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,186 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,188 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,190 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,193 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:08,195 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,197 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,199 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,201 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,203 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,206 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,210 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,212 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,214 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,216 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,219 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,221 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,223 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,226 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,228 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,230 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,233 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,235 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,237 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,239 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,242 copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,244 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,246 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,249 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,251 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,253 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,256 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,258 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,260 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,262 copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:08,264 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,267 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,269 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,271 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,273 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,276 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,278 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,280 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,282 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,285 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,287 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,289 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,291 copying lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,293 copying lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,296 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,298 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,300 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,302 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,305 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,307 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,309 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,311 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,313 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,316 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,318 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,320 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,322 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,325 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,327 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,329 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:08,331 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,334 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,336 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,338 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,340 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,343 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,345 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,347 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,350 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,352 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,354 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,357 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,359 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,361 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,363 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,366 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,368 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,370 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,372 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,374 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,376 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,378 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,380 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,383 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,385 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,387 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,389 copying lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,391 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,393 copying lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,396 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:08,398 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,400 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,402 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,404 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,407 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,409 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,411 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,413 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,416 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,418 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,420 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,422 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,424 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,427 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,429 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,431 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,433 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,436 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,438 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,440 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,442 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,445 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,447 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,450 copying lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,452 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,454 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,457 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,459 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,461 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,463 copying lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:08,466 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,468 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,470 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,472 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,474 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,476 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,478 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,481 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,483 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,485 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,487 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,489 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,492 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,494 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,496 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,498 copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,501 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,503 copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,505 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,507 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,510 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,512 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,514 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,516 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,519 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,521 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,523 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,525 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,527 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,529 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:08,532 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,534 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,536 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,538 copying lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,540 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,542 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,544 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,547 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,549 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,551 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,553 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,555 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,557 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,560 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,562 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,564 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,566 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,569 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,571 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,573 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,575 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,577 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,580 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,582 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,584 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,586 copying lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,589 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,591 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,593 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,595 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:08,597 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,599 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,601 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,604 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,606 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,608 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,610 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,612 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,614 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,616 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,618 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,620 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,622 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,624 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,626 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,629 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,631 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,633 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,635 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,637 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,639 copying lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,641 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,644 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,646 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,648 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,650 copying lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,652 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,654 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,657 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,659 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:08,661 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,663 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,666 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,668 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,670 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,672 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,674 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,676 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,678 copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,680 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,682 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,684 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,687 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,689 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,692 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,694 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,696 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,698 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,701 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,703 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,705 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,707 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,710 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,712 copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,714 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,717 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,719 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,721 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,724 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,726 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:08,728 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,730 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,732 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,735 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,737 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,739 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,741 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,743 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,745 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,747 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,749 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,752 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,754 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,756 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,758 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,760 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,763 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,765 copying lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,767 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,769 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,771 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,774 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,776 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,778 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,780 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,783 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,785 copying lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,787 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,789 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,791 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:08,794 creating build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,795 copying lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,797 copying lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,799 copying lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,801 copying lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,803 copying lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,806 copying lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,808 copying lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,810 copying lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,813 copying lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,815 copying lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,817 copying lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:08,819 copying lm_eval/tasks/xnli/xnli_vi.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,821 copying lm_eval/tasks/xnli/xnli_tr.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,824 copying lm_eval/tasks/xnli/xnli_hi.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,826 copying lm_eval/tasks/xnli/xnli_es.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,828 copying lm_eval/tasks/xnli/xnli_th.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,830 copying lm_eval/tasks/xnli/xnli_en.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,832 copying lm_eval/tasks/xnli/xnli_de.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,834 copying lm_eval/tasks/xnli/xnli_zh.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,836 copying lm_eval/tasks/xnli/xnli_ar.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,838 copying lm_eval/tasks/xnli/xnli_el.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,841 copying lm_eval/tasks/xnli/xnli_fr.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,843 copying lm_eval/tasks/xnli/xnli_ur.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,845 copying lm_eval/tasks/xnli/xnli_ru.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,848 copying lm_eval/tasks/xnli/_xnli.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,850 copying lm_eval/tasks/xnli/xnli_sw.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,852 copying lm_eval/tasks/xnli/xnli_bg.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:08,855 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:08,857 copying lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:08,859 copying lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:08,862 copying lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:08,864 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:08,866 copying lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:08,868 copying lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:08,871 copying lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:08,873 creating build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,874 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,877 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,879 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,881 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,883 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,885 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,888 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,890 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,893 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,895 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,897 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,900 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,903 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,905 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,907 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,909 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,912 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,914 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,916 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,918 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,921 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,923 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,925 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,927 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,930 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,932 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,934 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,936 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,938 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,941 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,943 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,945 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,948 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,950 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,952 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,954 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,956 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,959 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,961 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,963 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,965 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,967 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,969 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,972 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,974 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,976 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,978 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,981 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,983 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,985 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:08,987 creating build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:08,988 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:08,991 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:08,994 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:08,996 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:08,999 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,002 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,005 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,007 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,010 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,013 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,016 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,018 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,021 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,024 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,026 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,029 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,032 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,034 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,037 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,040 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,043 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,045 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,048 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,051 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,053 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,056 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,059 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,062 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,064 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,067 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,070 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,072 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,075 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,078 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,080 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,083 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,086 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,088 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,091 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,094 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,096 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,099 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,102 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,105 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,107 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,110 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,113 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,115 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,118 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,121 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:09,123 creating build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,124 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,127 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,129 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,131 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,133 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,135 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,138 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,140 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,142 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,144 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,146 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,148 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,150 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,153 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,155 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,157 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,159 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,162 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,164 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,166 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,168 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,170 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,173 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,175 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,177 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,179 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,181 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,183 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,185 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,188 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,190 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,192 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,194 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,196 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,198 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,200 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,203 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,205 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,207 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,209 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,211 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,214 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,216 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,218 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,220 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,223 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,225 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,227 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,229 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,231 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:09,233 creating build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,234 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,237 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,239 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,241 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,243 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,245 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,247 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,249 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,252 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,254 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,256 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,259 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,261 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,263 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,265 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,267 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,270 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,272 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,274 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,276 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,279 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,281 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,283 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,285 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,288 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,290 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,292 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,294 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,297 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,299 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,301 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,303 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,305 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,307 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,309 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,311 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,314 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,316 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,318 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,320 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,322 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,325 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,327 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,329 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,331 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,333 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,335 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,338 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,340 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,342 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:09,344 creating build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,345 copying lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,348 copying lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,350 copying lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,353 copying lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,355 copying lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,357 copying lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,360 copying lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,362 copying lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,364 copying lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,366 copying lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,368 copying lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,370 copying lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,373 copying lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,375 copying lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,377 copying lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,379 copying lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,381 copying lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,383 copying lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,385 copying lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,388 copying lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,390 copying lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,392 copying lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,394 copying lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,396 copying lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,398 copying lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,401 copying lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,403 copying lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,405 copying lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,407 copying lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,409 copying lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,411 copying lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,413 copying lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,416 copying lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,418 copying lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,420 copying lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,422 copying lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,425 copying lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,427 copying lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,429 copying lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,431 copying lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,433 copying lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,435 copying lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,437 copying lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,439 copying lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,442 copying lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,444 copying lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,446 copying lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,448 copying lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,450 copying lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,452 copying lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:09,454 copying lm_eval/tasks/meqsum/meqsum.yaml -> build/lib/lm_eval/tasks/meqsum 2026-09-01T00:39:09,456 copying lm_eval/tasks/glianorex/glianorex_en.yaml -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:39:09,459 copying lm_eval/tasks/glianorex/glianorex.yaml -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:39:09,461 copying lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:39:09,463 copying lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/lib/lm_eval/tasks/egyhellaswag 2026-09-01T00:39:09,466 copying lm_eval/tasks/swde/swde.yaml -> build/lib/lm_eval/tasks/swde 2026-09-01T00:39:09,468 copying lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/cnn_dailymail 2026-09-01T00:39:09,470 copying lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,472 copying lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,474 copying lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,476 copying lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,479 copying lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,481 copying lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,483 copying lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,485 copying lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,487 copying lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,489 copying lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,492 copying lm_eval/tasks/aclue/_aclue.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,494 copying lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,496 copying lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,498 copying lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,501 copying lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,503 copying lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:09,506 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:39:09,508 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,510 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,512 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,514 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,517 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,519 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,521 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,524 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,526 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,528 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,530 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,533 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,535 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,537 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,540 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,542 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,544 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,546 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,549 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,551 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,553 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,555 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,557 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,560 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,562 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,564 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,566 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,569 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,571 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,573 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,576 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,578 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,580 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,583 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,585 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,587 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,589 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,591 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,594 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,596 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,598 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,600 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,603 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,605 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,607 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,610 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,612 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,614 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,617 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,619 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,621 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,623 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,626 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,628 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,630 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,633 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,635 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,638 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:09,640 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:39:09,642 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:39:09,644 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,647 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,649 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,652 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,655 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,657 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,660 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,663 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,665 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,668 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:09,671 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,674 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,676 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,679 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,682 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,685 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,687 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,690 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,693 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,696 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,699 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,701 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,704 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,706 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,709 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,712 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,714 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,717 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,720 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,722 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,725 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,728 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,730 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,733 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,736 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,738 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,741 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,744 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,747 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,749 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,751 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,753 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,756 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,758 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,760 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,762 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,765 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,767 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,769 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,772 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,774 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,776 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,778 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,781 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,783 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,785 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,788 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,790 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,792 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,794 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,796 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,798 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,801 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,803 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,805 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,807 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,810 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,812 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,814 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:09,816 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:39:09,818 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:39:09,821 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:39:09,823 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:39:09,825 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:39:09,827 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:39:09,830 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:39:09,832 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:39:09,834 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:39:09,836 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:39:09,838 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:39:09,841 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:39:09,843 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:39:09,846 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:39:09,848 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:39:09,850 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:39:09,852 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:39:09,855 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:39:09,857 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:39:09,859 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:39:09,861 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:39:09,863 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:39:09,865 creating build/lib/lm_eval/tasks/lambada 2026-09-01T00:39:09,866 copying lm_eval/tasks/lambada/lambada_openai.yaml -> build/lib/lm_eval/tasks/lambada 2026-09-01T00:39:09,869 copying lm_eval/tasks/lambada/lambada_standard.yaml -> build/lib/lm_eval/tasks/lambada 2026-09-01T00:39:09,871 copying lm_eval/tasks/chartqa/chartqa.yaml -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:39:09,873 copying lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:39:09,875 copying lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:39:09,877 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:09,879 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:09,882 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:09,884 copying lm_eval/tasks/physics_gre/physics_gre_additional.yaml -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:39:09,886 copying lm_eval/tasks/physics_gre/physics_gre_all.yaml -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:39:09,889 copying lm_eval/tasks/physics_gre/physics_gre.yaml -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:39:09,891 creating build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,892 copying lm_eval/tasks/legalbench/corporate_lobbying.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,894 copying lm_eval/tasks/legalbench/contract_nli_notice_on_compelled_disclosure.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,896 copying lm_eval/tasks/legalbench/contract_nli_sharing_with_employees.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,898 copying lm_eval/tasks/legalbench/_contract_nli.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,900 copying lm_eval/tasks/legalbench/contract_nli_explicit_identification.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,903 copying lm_eval/tasks/legalbench/contract_nli_limited_use.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,905 copying lm_eval/tasks/legalbench/contract_nli_return_of_confidential_information.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,907 copying lm_eval/tasks/legalbench/_legalbench.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,909 copying lm_eval/tasks/legalbench/contract_nli_survival_of_obligations.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,911 copying lm_eval/tasks/legalbench/contract_nli_permissible_development_of_similar_information.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,913 copying lm_eval/tasks/legalbench/contract_nli_no_licensing.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,915 copying lm_eval/tasks/legalbench/international_citizenship_questions.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,918 copying lm_eval/tasks/legalbench/contract_nli_sharing_with_third-parties.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,920 copying lm_eval/tasks/legalbench/contract_nli_permissible_copy.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,922 copying lm_eval/tasks/legalbench/contract_nli_inclusion_of_verbally_conveyed_information.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,924 copying lm_eval/tasks/legalbench/contract_nli_confidentiality_of_agreement.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,927 copying lm_eval/tasks/legalbench/contract_nli_permissible_acquirement_of_similar_information.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,929 copying lm_eval/tasks/legalbench/contract_nli_permissible_post-agreement_possession.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,931 copying lm_eval/tasks/legalbench/abercrombie.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,933 copying lm_eval/tasks/legalbench/function_of_decision_section.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,935 copying lm_eval/tasks/legalbench/proa.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:09,937 copying lm_eval/tasks/slr_bench/slr_bench_all.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:39:09,939 copying lm_eval/tasks/slr_bench/slr_bench_easy.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:39:09,942 copying lm_eval/tasks/slr_bench/slr_bench_group.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:39:09,944 copying lm_eval/tasks/slr_bench/slr_bench_medium.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:39:09,946 copying lm_eval/tasks/slr_bench/slr_bench_hard.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:39:09,948 copying lm_eval/tasks/slr_bench/slr_bench_basic.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:39:09,950 creating build/lib/lm_eval/tasks/fld 2026-09-01T00:39:09,951 copying lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/lib/lm_eval/tasks/fld 2026-09-01T00:39:09,953 copying lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/lib/lm_eval/tasks/fld 2026-09-01T00:39:09,956 copying lm_eval/tasks/fld/fld_default.yaml -> build/lib/lm_eval/tasks/fld 2026-09-01T00:39:09,958 copying lm_eval/tasks/fld/fld_star.yaml -> build/lib/lm_eval/tasks/fld 2026-09-01T00:39:09,960 copying lm_eval/tasks/squad_completion/squad_completion.yaml -> build/lib/lm_eval/tasks/squad_completion 2026-09-01T00:39:09,962 creating build/lib/lm_eval/tasks/asdiv 2026-09-01T00:39:09,963 copying lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/lib/lm_eval/tasks/asdiv 2026-09-01T00:39:09,965 copying lm_eval/tasks/asdiv/default.yaml -> build/lib/lm_eval/tasks/asdiv 2026-09-01T00:39:09,967 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,969 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,971 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,973 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,975 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,978 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,980 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,982 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,984 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,986 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,988 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,990 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,992 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,994 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,996 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:09,998 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,000 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,002 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,004 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,007 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,009 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,011 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,013 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,015 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,018 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,020 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,022 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,024 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,026 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,028 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,030 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,032 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,035 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,037 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,039 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,041 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,044 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,046 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,048 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,050 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,052 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,055 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,057 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,060 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,062 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,064 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,066 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,068 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,071 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,073 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,075 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,077 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,079 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,082 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,084 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,086 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,088 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,091 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,093 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,096 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,098 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,101 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:10,103 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,105 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,107 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,110 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,112 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,114 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,116 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,118 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,120 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,122 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,124 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,127 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,129 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,131 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,133 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,135 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,137 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,139 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,142 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,144 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,146 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,149 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,151 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,153 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,155 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,157 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,159 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,162 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,164 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,166 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,168 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,170 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,172 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,174 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,176 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,178 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,181 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,183 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,185 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,187 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,190 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,192 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,194 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,196 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,198 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,200 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,203 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,205 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,207 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,210 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,212 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,214 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,217 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,219 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,221 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,223 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,225 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,228 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,230 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,232 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,234 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,237 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:10,239 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,241 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,243 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,246 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,248 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,250 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,253 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,255 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,257 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,259 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,262 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,264 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,266 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,269 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,271 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,273 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,275 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,277 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,279 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,282 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,284 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,286 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,288 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,290 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,292 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,294 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,296 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,298 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,300 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,302 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,304 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,306 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,308 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,310 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,312 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,315 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,317 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,319 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,321 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,323 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,325 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,327 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,329 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,331 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,333 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,335 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,337 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,339 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,341 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,343 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,345 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,347 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,350 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,352 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,354 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,356 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,358 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,360 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,362 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,364 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,367 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,369 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:10,371 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,373 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,375 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,377 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,380 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,382 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,384 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,386 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,388 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,390 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,392 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,394 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,396 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,398 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,400 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,402 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,404 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,406 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,408 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,410 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,412 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,414 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,416 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,418 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,420 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,422 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,424 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,426 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,428 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,430 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,433 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,435 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,437 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,438 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,440 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,442 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,444 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,446 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,448 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,450 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,452 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,454 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,456 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,458 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,460 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,463 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,465 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,467 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,469 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,471 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,473 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,475 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,477 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,479 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,481 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,483 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,485 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,487 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,489 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,491 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,493 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,495 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:10,497 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,499 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,501 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,503 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,505 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,508 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,510 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,512 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,514 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,516 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,518 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,520 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,522 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,524 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,526 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,528 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,530 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,532 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,534 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,536 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,538 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,541 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,542 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,544 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,546 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,548 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,550 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,552 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,554 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,556 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,558 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,560 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,562 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,565 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,567 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,569 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,571 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,573 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,575 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,577 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,579 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,581 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,583 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,586 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,588 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,590 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,592 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,594 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,596 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,598 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,600 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,602 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,604 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,606 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,608 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,610 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,612 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,614 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,617 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,619 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,621 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,623 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:10,625 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,628 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,630 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,632 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,634 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,636 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,638 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,640 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,642 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,645 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,647 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,649 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,651 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,653 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,655 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,657 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,659 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,661 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,663 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,665 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,667 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,669 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,671 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,673 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,675 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,677 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,680 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,682 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,684 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,686 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,688 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,690 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,692 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,694 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,697 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,699 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,701 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,703 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,705 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,707 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,709 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,711 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,713 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,715 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,717 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,719 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,721 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,723 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,726 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,728 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,730 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,732 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,734 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,736 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,738 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,741 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,743 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,745 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,747 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,749 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,751 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,753 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:10,755 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,757 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,759 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,761 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,763 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,765 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,767 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,769 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,771 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,773 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,775 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,777 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,779 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,782 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,784 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,786 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,788 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,790 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,792 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,794 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,796 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,798 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,800 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,802 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,804 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,806 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,808 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,811 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,813 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,814 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,817 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,819 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,821 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,822 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,824 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,827 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,829 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,831 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,833 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,835 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,837 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,839 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,841 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,843 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,845 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,847 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,849 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,851 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,853 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,856 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,858 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,861 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,863 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,866 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,868 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,870 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,871 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,873 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,876 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,878 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,880 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,882 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:10,884 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,886 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,888 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,890 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,892 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,894 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,896 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,898 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,900 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,902 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,904 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,906 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,908 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,910 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,912 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,914 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,916 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,919 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,920 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,922 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,924 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,926 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,928 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,930 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,932 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,934 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,936 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,939 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,941 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,943 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,945 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,947 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,949 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,951 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,953 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,955 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,957 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,959 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,961 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,963 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,966 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,968 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,970 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,972 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,974 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,976 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,978 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,980 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,982 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,984 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,986 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,988 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,990 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,992 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,994 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,996 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:10,998 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:11,000 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:11,003 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:11,005 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:11,007 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:11,009 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:11,011 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,013 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,015 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,017 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,019 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,021 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,023 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,025 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,027 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,029 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,031 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,033 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,036 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,038 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,040 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,042 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,044 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,046 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,048 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,050 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,052 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,054 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,056 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,058 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,060 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,062 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,064 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,066 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,068 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,071 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,073 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,075 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,077 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,079 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,081 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,083 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,085 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,087 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,089 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,092 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,094 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,096 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,098 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,100 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,102 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,104 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,106 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,108 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,110 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,112 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,114 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,116 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,119 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,121 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,123 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,125 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,127 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,129 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,131 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,133 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,135 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,137 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:11,139 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,141 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,143 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,145 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,147 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,149 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,151 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,153 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,155 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,157 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,159 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,161 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,163 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,165 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,167 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,169 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,171 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,173 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,176 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,178 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,180 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,182 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,184 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,186 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,188 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,190 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,192 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,194 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,196 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,198 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,200 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,202 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,204 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,206 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,208 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,210 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,212 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,215 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,217 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,219 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,221 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,223 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,225 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,227 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,229 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,232 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,234 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,236 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,239 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,241 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,243 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,245 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,248 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,251 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,253 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,256 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,258 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,260 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,262 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,265 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,267 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,269 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:11,271 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,274 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,276 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,278 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,281 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,283 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,285 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,287 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,290 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,292 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,295 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,297 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,300 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,303 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,305 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,308 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,310 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,312 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,314 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,317 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,319 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,321 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,323 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,326 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,328 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,330 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,333 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,335 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,337 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,339 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,342 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,344 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,346 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,348 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,351 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,353 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,355 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,358 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,360 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,362 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,364 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,366 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,368 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,370 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,373 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,375 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,377 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,379 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,381 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,383 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,385 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,387 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,390 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,392 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,394 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,396 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,399 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,401 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,403 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,405 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,408 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,410 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:11,412 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,414 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,417 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,419 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,421 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,423 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,426 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,428 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,430 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,432 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,434 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,436 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,438 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,440 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,442 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,444 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,447 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,449 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,451 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,453 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,455 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,457 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,460 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,462 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,464 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,466 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,468 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,470 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,472 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,475 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,477 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,479 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,481 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,483 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,485 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,488 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,490 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,492 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,494 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,497 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,499 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,501 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,504 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,506 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,508 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,510 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,513 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,515 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,517 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,519 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,521 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,524 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,526 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,528 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,530 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,532 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,534 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,536 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,538 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,540 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,542 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,544 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:11,546 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,549 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,551 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,553 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,555 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,557 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,559 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,561 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,563 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,566 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,568 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,570 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,572 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,574 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,577 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,579 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,581 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,583 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,586 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,588 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,590 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,592 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,594 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,596 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,599 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,601 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,603 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,605 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,607 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,609 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,612 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,614 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,616 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,618 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,620 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,623 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,625 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,627 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,629 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,631 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,634 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,636 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,638 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,640 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,642 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,644 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,646 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,648 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,650 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,652 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,654 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,657 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,659 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,661 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,663 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,665 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,667 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,669 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,671 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,673 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,676 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,678 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:11,680 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,682 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,684 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,686 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,689 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,691 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,693 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,695 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,697 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,699 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,702 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,703 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,705 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,707 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,709 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,712 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,714 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,716 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,718 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,720 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,722 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,724 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,726 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,728 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,730 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,732 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,735 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,737 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,739 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,741 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,743 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,745 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,747 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,750 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,752 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,754 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,756 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,758 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,760 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,763 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,765 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,767 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,769 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,771 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,773 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,775 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,777 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,779 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,781 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,783 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,786 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,788 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,790 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,792 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,794 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,796 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,798 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,801 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,803 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,805 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,807 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,809 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:11,811 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,813 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,816 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,818 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,820 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,822 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,824 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,826 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,828 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,830 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,832 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,834 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,837 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,839 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,841 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,843 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,845 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,847 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,849 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,851 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,853 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,856 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,858 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,860 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,862 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,864 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,867 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,869 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,871 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,873 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,875 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,877 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,879 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,881 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,883 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,885 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,887 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,889 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,891 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,894 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,896 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,898 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,900 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,902 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,904 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,907 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,909 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,911 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,913 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,916 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,918 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,920 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,922 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,924 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,927 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,929 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,931 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,933 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,935 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,938 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,940 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,942 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:11,944 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,947 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,949 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,951 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,953 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,955 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,958 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,960 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,962 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,964 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,967 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,969 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,971 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,973 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,976 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,978 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,980 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,982 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,984 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,986 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,989 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,991 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,993 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,995 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,997 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:11,999 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,001 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,003 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,006 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,008 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,010 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,012 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,014 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,016 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,018 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,021 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,023 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,025 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,027 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,029 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,032 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,034 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,036 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,038 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,040 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,042 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,044 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,047 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,049 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,051 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,053 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,056 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,058 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,060 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,062 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,064 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,067 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,069 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,071 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,073 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,076 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,078 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:12,080 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,082 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,085 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,087 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,089 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,091 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,093 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,096 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,098 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,100 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,102 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,104 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,106 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,108 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,110 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,113 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,115 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,117 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,119 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,121 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,124 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,126 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,129 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,131 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,133 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,135 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,137 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,140 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,142 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,144 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,146 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,148 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,150 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,152 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,155 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,157 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,159 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,161 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,163 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,165 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,167 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,169 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,171 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,173 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,176 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,178 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,181 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,183 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,185 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,187 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,189 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,191 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,194 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,196 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,198 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,200 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,202 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,204 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,207 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,209 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,211 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,213 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:12,215 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,217 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,219 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,221 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,223 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,226 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,228 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,230 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,232 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,234 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,236 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,239 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,241 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,243 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,245 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,247 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,249 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,252 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,254 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,256 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,259 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,261 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,263 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,265 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,267 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,270 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,272 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,274 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,276 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,279 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,281 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,283 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,285 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,287 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,290 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,292 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,294 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,296 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,299 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,301 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,303 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,305 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,307 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,310 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,312 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,314 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,316 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,319 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,321 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,323 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,325 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,327 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,329 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,331 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,334 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,336 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,338 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,340 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,342 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,344 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,347 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,349 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:12,351 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,353 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,356 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,358 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,360 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,362 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,364 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,367 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,369 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,371 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,373 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,376 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,378 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,380 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,382 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,384 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,387 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,389 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,391 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,394 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,396 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,398 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,400 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,403 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,405 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,407 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,410 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,412 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,415 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,417 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,419 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,421 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,424 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,426 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,428 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,430 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,432 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,435 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,437 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,439 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,441 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,443 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,446 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,448 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,450 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,453 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,455 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,457 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,460 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,462 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,464 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,466 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,468 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,471 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,473 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,475 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,478 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,480 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,482 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,485 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,487 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,489 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:12,491 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,494 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,496 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,498 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,500 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,503 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,505 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,507 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,509 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,511 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,514 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,516 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,518 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,520 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,523 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,525 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,527 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,529 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,532 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,534 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,536 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,538 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,541 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,543 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,546 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,548 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,550 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,553 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,555 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,557 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,559 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,562 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,564 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,566 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,569 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,571 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,574 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,577 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,580 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,583 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,586 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,588 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,591 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,594 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,597 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,599 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,602 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,605 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,608 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,611 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,614 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,617 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,620 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,623 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,626 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,628 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,631 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,634 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,636 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,639 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,642 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,645 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:12,647 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,650 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,653 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,655 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,658 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,661 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,664 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,667 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,669 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,672 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,674 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,676 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,678 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,680 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,682 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,685 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,687 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,689 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,692 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,694 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,696 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,698 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,700 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,702 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,705 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,707 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,709 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,711 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,713 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,716 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,718 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,720 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,722 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,725 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,727 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,729 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,731 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,734 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,736 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,738 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,741 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,743 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,746 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,748 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,750 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,752 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,755 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,757 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,759 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,762 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,764 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,766 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,769 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,771 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,773 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,775 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,778 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,780 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,782 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,784 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,786 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,789 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:12,791 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,793 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,796 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,798 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,800 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,803 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,805 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,807 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,810 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,812 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,814 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,816 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,819 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,821 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,823 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,826 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,828 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,830 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,832 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,835 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,837 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,839 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,842 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,844 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,846 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,848 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,851 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,853 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,855 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,858 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,860 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,863 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,866 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,868 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,870 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,873 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,875 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,877 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,879 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,882 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,884 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,886 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,888 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,890 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,893 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,895 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,897 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,899 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,902 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,904 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,906 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,909 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,911 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,913 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,915 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,918 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,920 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,922 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,924 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,926 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,929 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,931 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:12,933 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,935 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,937 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,939 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,941 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,943 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,946 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,948 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,950 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,952 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,954 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,957 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,959 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,961 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,963 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,966 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,968 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,970 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,972 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,975 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,977 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,980 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,982 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,984 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,986 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,988 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,991 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,993 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,995 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,997 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:12,999 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,001 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,003 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,006 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,008 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,010 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,012 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,014 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,017 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,019 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,021 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,023 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,025 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,028 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,030 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,032 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,034 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,037 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,039 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,041 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,043 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,046 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,048 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,050 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,052 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,055 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,057 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,059 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,061 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,063 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,066 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,068 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:13,070 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,072 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,074 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,077 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,079 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,081 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,083 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,085 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,087 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,089 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,091 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,093 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,095 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,097 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,099 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,101 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,103 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,105 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,107 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,109 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,111 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,113 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,115 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,117 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,119 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,121 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,123 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,125 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,127 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,129 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,131 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,133 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,135 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,137 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,140 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,141 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,144 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,146 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,148 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,150 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,152 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,153 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,155 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,157 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,159 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,161 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,163 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,165 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,167 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,168 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,170 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,172 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,174 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,176 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,178 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,180 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,182 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,184 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,186 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,188 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,191 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,193 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:13,195 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,197 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,199 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,202 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,204 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,206 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,208 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,210 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,212 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,214 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,216 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,218 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,221 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,223 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,225 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,227 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,229 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,232 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,234 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,236 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,238 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,240 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,242 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,244 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,246 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,249 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,251 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,253 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,255 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,258 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,260 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,262 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,264 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,266 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,268 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,270 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,272 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,274 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,277 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,279 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,281 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,283 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,286 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,288 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,290 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,292 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,295 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,297 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,299 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,301 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,303 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,306 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,308 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,310 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,313 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,315 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,317 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,319 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,321 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,323 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,326 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,328 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:13,330 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,332 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,334 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,336 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,339 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,341 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,343 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,345 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,348 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,350 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,352 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,354 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,356 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,359 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,361 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,363 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,365 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,367 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,370 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,372 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,374 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,376 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,378 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,380 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,382 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,385 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,387 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,389 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,391 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,393 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,395 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,398 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,400 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,402 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,404 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,406 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,408 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,411 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,413 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,415 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,418 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,420 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,422 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,424 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,427 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,429 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,431 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,433 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,436 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,438 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,440 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,442 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,444 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,447 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,449 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,451 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,453 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,455 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,458 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,460 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,462 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,464 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:13,467 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,469 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,471 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,473 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,476 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,478 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,480 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,483 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,485 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,487 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,489 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,491 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,494 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,496 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,498 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,500 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,502 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,505 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,507 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,509 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,511 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,514 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,516 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,518 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,520 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,523 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,525 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,527 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,530 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,532 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,534 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,537 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,539 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,541 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,543 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,546 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,548 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,550 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,552 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,554 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,557 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,559 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,561 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,563 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,565 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,568 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,570 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,572 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,574 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,577 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,579 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,581 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,583 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,585 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,588 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,590 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,592 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,594 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,597 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,599 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,601 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,603 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:13,605 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,608 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,610 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,612 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,614 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,617 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,619 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,621 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,623 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,626 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,628 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,630 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,632 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,634 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,637 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,639 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,641 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,643 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,646 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,648 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,650 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,653 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,655 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,658 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,660 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,662 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,664 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,667 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,669 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,671 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,673 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,675 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,677 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,680 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,682 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,684 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,686 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,688 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,691 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,693 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,695 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,697 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,699 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,702 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,704 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,707 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,709 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,711 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,713 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,716 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,718 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,720 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,722 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,724 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,727 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,729 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,731 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,734 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,736 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,738 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,740 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,742 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:13,745 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,747 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,749 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,751 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,754 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,756 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,758 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,760 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,763 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,765 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,767 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,770 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,772 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,774 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,777 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,779 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,781 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,783 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,786 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,788 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,790 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,792 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,794 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,797 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,799 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,801 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,803 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,805 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,808 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,810 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,812 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,814 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,817 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,819 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,821 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,824 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,826 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,828 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,831 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,833 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,835 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,838 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,840 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,842 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,844 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,846 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,849 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,851 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,853 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,856 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,858 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,860 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,862 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,865 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,867 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,869 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,871 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,874 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,876 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,879 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,881 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,883 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:13,886 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,888 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,890 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,893 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,895 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,898 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,900 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,902 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,904 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,907 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,909 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,911 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,913 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,916 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,918 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,920 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,922 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,925 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,927 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,929 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,932 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,934 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,936 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,938 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,941 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,943 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,945 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,948 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,950 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,952 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,954 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,957 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,959 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,961 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,964 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,966 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,968 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,970 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,973 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,975 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,977 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,979 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,982 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,984 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,986 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,988 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,991 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,993 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,996 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:13,998 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,000 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,003 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,005 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,007 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,010 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,012 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,014 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,016 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,019 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,021 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,023 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,025 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:14,027 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,029 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,032 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,034 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,036 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,038 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,040 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,043 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,045 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,047 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,049 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,051 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,054 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,056 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,058 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,060 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,063 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,065 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,067 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,070 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,072 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,075 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,077 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,079 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,081 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,083 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,086 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,088 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,090 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,092 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,095 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,097 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,099 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,102 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,104 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,106 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,108 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,111 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,113 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,115 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,118 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,120 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,122 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,124 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,127 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,129 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,131 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,134 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,136 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,138 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,140 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,142 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,144 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,147 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,149 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,151 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,153 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,155 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,158 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,160 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,162 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,164 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:14,166 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,169 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,171 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,173 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,175 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,178 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,180 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,182 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,184 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,187 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,189 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,191 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,193 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,195 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,198 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,200 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,202 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,204 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,206 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,209 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,211 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,213 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,215 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,218 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,220 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,222 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,224 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,226 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,229 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,231 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,233 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,236 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,238 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,240 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,242 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,245 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,247 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,249 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,251 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,254 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,256 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,258 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,260 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,262 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,264 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,267 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,269 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,271 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,273 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,275 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,278 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,280 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,282 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,285 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,287 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,289 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,291 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,294 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,296 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,299 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,301 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,303 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:14,305 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,308 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,310 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,312 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,314 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,317 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,319 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,321 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,323 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,326 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,328 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,330 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,332 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,334 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,336 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,339 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,341 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,343 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,345 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,348 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,350 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,352 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,354 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,357 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,359 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,361 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,363 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,366 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,368 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,370 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,372 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,374 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,376 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,378 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,381 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,383 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,385 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,387 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,390 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,392 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,394 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,396 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,399 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,401 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,403 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,405 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,408 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,410 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,412 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,414 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,416 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,419 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,421 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,423 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,426 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,428 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,430 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,432 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,434 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,437 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,439 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,441 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:14,443 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,446 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,448 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,450 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,452 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,455 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,457 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,459 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,462 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,464 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,466 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,469 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,471 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,473 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,476 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,478 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,480 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,483 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,485 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,487 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,490 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,492 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,494 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,496 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,498 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,500 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,502 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,504 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,506 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,509 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,511 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,513 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,515 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,517 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,519 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,522 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,524 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,526 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,529 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,531 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,533 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,535 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,538 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,540 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,542 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,544 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,547 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,549 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,551 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,554 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,556 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,558 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,560 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,562 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,565 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,567 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,569 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,571 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,573 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,576 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,578 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,580 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:14,582 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,584 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,587 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,589 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,591 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,593 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,596 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,598 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,600 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,603 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,605 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,607 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,609 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,611 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,613 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,615 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,618 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,620 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,622 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,624 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,627 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,629 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,631 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,633 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,635 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,637 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,640 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,642 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,644 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,646 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,648 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,650 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,653 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,655 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,657 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,659 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,662 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,664 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,666 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,668 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,670 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,672 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,674 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,677 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,679 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,681 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,683 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,685 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,687 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,689 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,691 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,693 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,695 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,697 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,699 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,701 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,703 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,705 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,707 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,709 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,711 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,713 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:14,715 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,717 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,719 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,721 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,723 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,725 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,727 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,729 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,731 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,733 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,735 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,737 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,739 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,741 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,743 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,745 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,747 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,749 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,751 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,753 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,756 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,758 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,760 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,762 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,764 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,766 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,768 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,770 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,772 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,774 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,777 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,779 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,781 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,783 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,785 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,787 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,789 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,791 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,793 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,795 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,798 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,800 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,802 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,804 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,806 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,809 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,811 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,813 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,815 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,817 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,819 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,821 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,823 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,825 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,827 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,829 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,831 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,833 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,836 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,838 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,840 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,842 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:14,844 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,846 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,848 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,850 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,853 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,855 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,857 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,859 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,861 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,863 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,865 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,867 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,870 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,872 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,874 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,876 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,877 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,879 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,881 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,883 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,885 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,887 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,889 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,891 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,893 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,896 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,898 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,900 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,902 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,904 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,906 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,908 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,910 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,912 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,914 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,916 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,918 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,920 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,922 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,924 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,926 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,928 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,930 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,931 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,933 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,935 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,937 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,939 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,941 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,943 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,945 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,947 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,949 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,951 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,953 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,955 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,957 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,959 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,961 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,963 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,965 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,967 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:14,969 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,971 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,973 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,975 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,977 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,979 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,981 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,983 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,985 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,987 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,989 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,991 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,993 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,995 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,997 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:14,999 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,001 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,003 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,005 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,007 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,009 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,011 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,013 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,015 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,017 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,019 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,021 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,023 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,025 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,027 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,029 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,031 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,033 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,035 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,037 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,039 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,041 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,043 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,045 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,047 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,050 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,052 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,054 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,056 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,059 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,061 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,063 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,065 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,067 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,070 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,072 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,074 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,076 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,079 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,081 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,083 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,085 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,087 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,089 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,091 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,093 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,095 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:15,097 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,099 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,101 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,103 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,105 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,107 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,109 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,111 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,113 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,115 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,118 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,120 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,122 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,124 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,126 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,128 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,131 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,133 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,135 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,137 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,139 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,142 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,144 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,146 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,148 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,150 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,152 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,155 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,157 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,159 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,161 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,164 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,166 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,168 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,170 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,173 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,175 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,177 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,180 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,182 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,184 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,186 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,189 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,191 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,193 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,195 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,198 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,200 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,202 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,204 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,206 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,208 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,211 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,213 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,215 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,217 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,220 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,222 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,224 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,227 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,229 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,231 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:15,234 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,236 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,238 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,240 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,243 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,245 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,247 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,250 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,252 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,254 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,256 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,258 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,260 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,262 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,265 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,267 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,269 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,271 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,273 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,276 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,278 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,280 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,282 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,284 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,287 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,289 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,291 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,294 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,296 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,298 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,300 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,303 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,305 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,307 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,309 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,312 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,314 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,316 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,318 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,320 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,322 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,324 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,327 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,329 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,331 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,333 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,335 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,337 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,340 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,342 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,344 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,346 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,349 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,351 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,353 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,355 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,357 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,360 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,362 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,364 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,366 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,369 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:15,371 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,373 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,375 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,378 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,380 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,382 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,384 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,386 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,388 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,390 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,392 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,395 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,397 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,399 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,402 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,404 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,406 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,408 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,410 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,413 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,415 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,417 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,419 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,422 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,424 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,427 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,429 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,431 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,433 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,436 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,438 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,440 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,442 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,444 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,447 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,449 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,451 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,454 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,456 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,458 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,460 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,463 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,465 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,467 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,469 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,472 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,474 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,476 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,479 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,481 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,483 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,486 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,488 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,490 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,492 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,494 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,496 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,498 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,501 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,503 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,505 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,507 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:15,509 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,511 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,514 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,516 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,518 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,520 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,523 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,525 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,527 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,529 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,531 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,534 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,536 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,538 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,541 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,543 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,545 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,547 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,549 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,551 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,553 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,556 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,558 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,560 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,562 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,564 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,567 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,569 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,571 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,573 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,576 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,578 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,580 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,582 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,585 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,587 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,589 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,591 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,593 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,595 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,598 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,600 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,602 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,604 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,606 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,608 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,610 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,612 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,614 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,615 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,617 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,619 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,621 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,623 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,625 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,627 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,629 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,631 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,633 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,635 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,637 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,639 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:15,641 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:39:15,643 copying lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:39:15,645 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:39:15,647 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:39:15,649 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:39:15,652 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:39:15,654 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:39:15,656 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:39:15,658 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:39:15,660 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:39:15,661 copying lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:39:15,663 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:39:15,665 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:39:15,667 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:39:15,669 copying lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:39:15,671 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:39:15,673 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:39:15,675 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:39:15,677 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:39:15,679 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:39:15,681 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:39:15,683 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:39:15,684 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:39:15,686 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:39:15,688 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:39:15,690 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:39:15,693 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:39:15,695 copying lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:39:15,697 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:39:15,699 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:39:15,701 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:39:15,703 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:39:15,705 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:39:15,707 copying lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:39:15,709 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:39:15,711 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:39:15,713 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:39:15,715 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:39:15,717 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:39:15,719 copying lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:39:15,721 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:39:15,723 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:39:15,725 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:39:15,727 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:39:15,729 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:39:15,730 copying lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:39:15,732 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:39:15,734 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:39:15,736 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:39:15,738 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:39:15,740 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:39:15,743 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:39:15,745 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:39:15,747 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:39:15,751 copying lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:39:15,753 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:39:15,755 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:39:15,758 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:39:15,760 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:39:15,762 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:39:15,765 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:39:15,767 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:39:15,769 copying lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:39:15,771 copying lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:39:15,773 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:39:15,775 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:39:15,778 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:39:15,780 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:39:15,782 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:39:15,784 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:39:15,787 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:39:15,789 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:39:15,791 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:39:15,793 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:39:15,796 copying lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:39:15,798 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:39:15,800 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:39:15,803 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:39:15,805 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:39:15,807 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:39:15,809 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:39:15,812 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:39:15,814 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:39:15,816 copying lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:39:15,819 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:39:15,821 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:39:15,823 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:39:15,825 copying lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:39:15,828 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:39:15,830 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:39:15,832 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:39:15,834 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:39:15,837 copying lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:39:15,839 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:39:15,841 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:39:15,843 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:39:15,845 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:39:15,847 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:39:15,849 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:39:15,851 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:39:15,854 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:39:15,856 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:39:15,858 copying lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:39:15,860 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:39:15,863 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:39:15,865 creating build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,866 copying lm_eval/tasks/longbench2/news_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,869 copying lm_eval/tasks/longbench2/translate.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,871 copying lm_eval/tasks/longbench2/graph.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,873 copying lm_eval/tasks/longbench2/_longbench2_structured.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,875 copying lm_eval/tasks/longbench2/longbench2_code.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,877 copying lm_eval/tasks/longbench2/_longbench2_incontext.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,880 copying lm_eval/tasks/longbench2/agent_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,882 copying lm_eval/tasks/longbench2/detective.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,884 copying lm_eval/tasks/longbench2/_longbench2_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,886 copying lm_eval/tasks/longbench2/govt_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,888 copying lm_eval/tasks/longbench2/legal_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,890 copying lm_eval/tasks/longbench2/table.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,893 copying lm_eval/tasks/longbench2/_longbench2_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,895 copying lm_eval/tasks/longbench2/dialogue_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,897 copying lm_eval/tasks/longbench2/fin_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,899 copying lm_eval/tasks/longbench2/lit_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,901 copying lm_eval/tasks/longbench2/govt_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,903 copying lm_eval/tasks/longbench2/many_shot.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,906 copying lm_eval/tasks/longbench2/_longbench2_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,908 copying lm_eval/tasks/longbench2/event_order.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,910 copying lm_eval/tasks/longbench2/fin_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,912 copying lm_eval/tasks/longbench2/legal_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,914 copying lm_eval/tasks/longbench2/academic_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,916 copying lm_eval/tasks/longbench2/user_guide.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,918 copying lm_eval/tasks/longbench2/_longbench2.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,921 copying lm_eval/tasks/longbench2/academic_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:15,923 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,925 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,927 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,929 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,932 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,934 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,936 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,938 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,940 copying lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:15,942 copying lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,944 copying lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,947 copying lm_eval/tasks/basque_bench/paws_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,949 copying lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,951 copying lm_eval/tasks/basque_bench/basque_bench.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,954 copying lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,956 copying lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,958 copying lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,960 copying lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:15,962 copying lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,965 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,967 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,969 copying lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,971 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,973 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,975 copying lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,978 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,980 copying lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,982 copying lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,984 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,986 copying lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,988 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,990 copying lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,993 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,995 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,997 copying lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:15,999 copying lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,001 copying lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,004 copying lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,006 copying lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,008 copying lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,010 copying lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,012 copying lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,015 copying lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,017 copying lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,019 copying lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,021 copying lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,024 copying lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,026 copying lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,028 copying lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,030 copying lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,033 copying lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,035 copying lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,037 copying lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:16,039 copying lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,041 copying lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,043 copying lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,045 copying lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,047 copying lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,049 copying lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,051 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,053 copying lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,056 copying lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,058 copying lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,060 copying lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,062 copying lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,064 copying lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,067 copying lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,069 copying lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,071 copying lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,073 copying lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,075 copying lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,078 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,080 copying lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,082 copying lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,084 copying lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,087 copying lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,089 copying lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,091 copying lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,093 copying lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,096 copying lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,098 copying lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,100 copying lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,103 copying lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,105 copying lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,107 copying lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,109 copying lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,111 copying lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,113 copying lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,115 copying lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,117 copying lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,120 copying lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,122 copying lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,124 copying lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,127 copying lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,129 copying lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,131 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,133 copying lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,136 copying lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,138 copying lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,140 copying lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:16,142 copying lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:39:16,144 copying lm_eval/tasks/kormedmcqa/pharm.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:39:16,147 copying lm_eval/tasks/kormedmcqa/doctor.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:39:16,149 copying lm_eval/tasks/kormedmcqa/dentist.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:39:16,151 copying lm_eval/tasks/kormedmcqa/nurse.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:39:16,153 copying lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,156 copying lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,158 copying lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,160 copying lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,162 copying lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,165 copying lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,167 copying lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,169 copying lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,172 copying lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,174 copying lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,176 copying lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,178 copying lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,180 copying lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,182 copying lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,185 copying lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,187 copying lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,189 copying lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,191 copying lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,193 copying lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,195 copying lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,198 copying lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,200 copying lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,202 copying lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,204 copying lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,206 copying lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,208 copying lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,210 copying lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,212 copying lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,215 copying lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,217 copying lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,219 copying lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,221 copying lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,224 copying lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,226 copying lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,228 copying lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,230 copying lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,232 copying lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,234 copying lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,237 copying lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,239 copying lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,241 copying lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,243 copying lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,245 copying lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,248 copying lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,250 copying lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,252 copying lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,254 copying lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,256 copying lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,258 copying lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,261 copying lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,263 copying lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,265 copying lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,267 copying lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,269 copying lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,271 copying lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,273 copying lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,275 copying lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,277 copying lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,279 copying lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,282 copying lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,284 copying lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,286 copying lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,288 copying lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,290 copying lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,293 copying lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,295 copying lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,297 copying lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,299 copying lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:16,301 copying lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,303 copying lm_eval/tasks/mmmu/_art_and_design.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,306 copying lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,308 copying lm_eval/tasks/mmmu/mmmu_music.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,310 copying lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,313 copying lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,315 copying lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,317 copying lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,319 copying lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,322 copying lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,324 copying lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,326 copying lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,328 copying lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,330 copying lm_eval/tasks/mmmu/mmmu_history.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,333 copying lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,335 copying lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,337 copying lm_eval/tasks/mmmu/_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,339 copying lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,341 copying lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,343 copying lm_eval/tasks/mmmu/mmmu_design.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,345 copying lm_eval/tasks/mmmu/_mmmu.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,347 copying lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,349 copying lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,351 copying lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,353 copying lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,356 copying lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,358 copying lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,360 copying lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,362 copying lm_eval/tasks/mmmu/mmmu_math.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,364 copying lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,366 copying lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,368 copying lm_eval/tasks/mmmu/mmmu_art.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,371 copying lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,373 copying lm_eval/tasks/mmmu/_business.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,375 copying lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,377 copying lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,379 copying lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:16,382 copying lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/lib/lm_eval/tasks/eus_trivia 2026-09-01T00:39:16,384 copying lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:39:16,386 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:39:16,388 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:39:16,390 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:39:16,392 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,395 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,397 copying lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,399 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,401 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,404 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,406 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,408 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,410 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:16,412 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:39:16,414 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:39:16,416 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:39:16,418 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:39:16,420 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:39:16,423 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:39:16,425 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:39:16,427 copying lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:39:16,429 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:39:16,431 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:39:16,433 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:39:16,436 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:39:16,438 copying lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:39:16,440 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:39:16,442 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:39:16,444 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:39:16,446 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:39:16,449 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:39:16,451 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:39:16,453 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:39:16,455 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:39:16,457 copying lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:39:16,460 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:39:16,462 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:39:16,464 copying lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:39:16,466 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:39:16,468 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:39:16,470 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:39:16,472 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:39:16,475 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:39:16,477 copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:39:16,479 copying lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:39:16,481 copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:39:16,483 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:39:16,485 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:39:16,488 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:39:16,490 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:39:16,492 copying lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:39:16,494 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:39:16,497 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:39:16,499 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:39:16,501 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:39:16,503 copying lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:39:16,506 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:39:16,508 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:39:16,510 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:39:16,512 copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:39:16,514 copying lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:39:16,516 copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:39:16,518 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:39:16,520 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:39:16,522 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:39:16,525 copying lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:39:16,527 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:39:16,529 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:39:16,531 copying lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:39:16,534 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:39:16,536 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:39:16,538 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:39:16,540 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:39:16,542 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:39:16,544 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:39:16,547 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:39:16,549 copying lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:39:16,551 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:39:16,553 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:39:16,555 copying lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:39:16,558 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:39:16,560 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:39:16,562 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:39:16,564 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:39:16,566 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:39:16,568 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:39:16,571 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:39:16,573 copying lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:39:16,575 copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:39:16,577 copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:39:16,579 copying lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:39:16,581 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:39:16,583 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:39:16,586 copying lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:39:16,588 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:39:16,590 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:39:16,592 copying lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:39:16,594 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:39:16,597 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:39:16,599 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:39:16,601 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:39:16,603 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:39:16,605 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:39:16,608 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:39:16,610 copying lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:39:16,612 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:39:16,614 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:39:16,616 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:39:16,618 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:39:16,620 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:39:16,622 copying lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:39:16,625 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:39:16,627 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:39:16,629 copying lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:39:16,631 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:39:16,633 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:39:16,635 copying lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:39:16,638 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:39:16,640 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:39:16,642 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:39:16,644 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:39:16,647 copying lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:39:16,649 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:39:16,651 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:39:16,653 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:39:16,655 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:39:16,658 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:39:16,660 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:39:16,662 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:39:16,664 copying lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north_macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:39:16,666 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:39:16,669 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:39:16,671 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:39:16,673 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:39:16,675 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:39:16,678 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:39:16,680 copying lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:39:16,682 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:39:16,684 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:39:16,686 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:39:16,689 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:39:16,691 copying lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:39:16,693 copying lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:39:16,695 copying lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:39:16,698 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:39:16,700 copying lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:39:16,702 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:39:16,704 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:39:16,706 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:16,709 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:16,711 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:16,713 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:16,715 copying lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:16,717 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:16,720 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:16,722 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:16,724 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,726 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,728 copying lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,730 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,733 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,735 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,737 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,740 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,742 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:16,744 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:39:16,746 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:39:16,748 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:39:16,750 copying lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:39:16,753 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:39:16,755 copying lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:39:16,757 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:39:16,759 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:39:16,762 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:39:16,765 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:39:16,767 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:39:16,769 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:39:16,772 copying lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:39:16,774 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:39:16,776 copying lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:39:16,778 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:39:16,781 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:39:16,783 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:39:16,785 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:39:16,787 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:39:16,790 copying lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:39:16,792 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:39:16,794 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:39:16,796 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:39:16,799 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:39:16,801 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:39:16,803 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:39:16,806 copying lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:39:16,808 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:39:16,810 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:39:16,812 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:39:16,815 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:39:16,817 copying lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:39:16,819 copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:39:16,821 copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:39:16,824 copying lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:39:16,826 copying lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:39:16,828 copying lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:39:16,830 copying lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:39:16,832 copying lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:39:16,834 copying lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:39:16,837 copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:39:16,839 copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:39:16,841 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,843 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,846 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,848 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,850 copying lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,852 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,855 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,857 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,859 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:16,861 copying lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:39:16,863 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:39:16,866 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:39:16,868 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:39:16,870 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:39:16,873 copying lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:39:16,875 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:39:16,877 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:39:16,879 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:39:16,881 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,883 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,885 copying lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,888 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,890 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,892 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,894 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,896 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,899 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:16,901 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:39:16,903 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:39:16,905 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:39:16,908 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:39:16,910 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:39:16,912 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:39:16,914 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:39:16,917 copying lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:39:16,919 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:39:16,922 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:39:16,924 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:39:16,926 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:39:16,928 copying lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:39:16,930 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:39:16,933 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:39:16,935 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:39:16,937 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:39:16,939 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:39:16,942 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:39:16,944 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:39:16,946 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:39:16,948 copying lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:39:16,950 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:39:16,953 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:39:16,955 copying lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:39:16,957 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:39:16,960 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:39:16,962 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:39:16,964 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:39:16,966 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:39:16,969 copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:39:16,971 copying lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:39:16,973 copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:39:16,975 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:39:16,978 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:39:16,980 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:39:16,982 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:39:16,984 copying lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:39:16,986 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:39:16,988 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:39:16,991 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:39:16,993 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:39:16,995 copying lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:39:16,997 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:39:16,999 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:39:17,002 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:39:17,004 copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:39:17,006 copying lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:39:17,008 copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:39:17,010 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:39:17,013 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:39:17,015 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:39:17,017 copying lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:39:17,019 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:39:17,021 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:39:17,024 copying lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:39:17,026 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:39:17,028 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:39:17,030 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:39:17,032 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:39:17,035 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:39:17,037 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:39:17,039 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:39:17,041 copying lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:39:17,043 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:39:17,045 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:39:17,048 copying lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:39:17,050 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:39:17,052 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:39:17,054 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:39:17,057 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:39:17,059 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:39:17,061 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:39:17,063 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:39:17,065 copying lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:39:17,067 copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:39:17,070 copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:39:17,072 copying lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:39:17,074 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:39:17,076 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:39:17,078 copying lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:39:17,080 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:39:17,082 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:39:17,085 copying lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:39:17,087 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:39:17,089 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:39:17,091 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:39:17,093 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:39:17,095 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:39:17,097 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:39:17,099 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:39:17,101 copying lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:39:17,103 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:39:17,106 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:39:17,108 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:39:17,110 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:39:17,112 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:39:17,114 copying lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:39:17,116 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:39:17,118 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:39:17,120 copying lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:39:17,122 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:39:17,125 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:39:17,127 copying lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:39:17,129 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:39:17,131 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:39:17,133 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:39:17,135 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:39:17,137 copying lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:39:17,139 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:39:17,141 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:39:17,143 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:39:17,146 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:39:17,148 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:39:17,150 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:39:17,152 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:39:17,154 copying lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north_macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:39:17,156 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:39:17,158 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:39:17,160 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:39:17,162 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:39:17,165 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:39:17,167 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:39:17,169 copying lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:39:17,171 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:39:17,173 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:39:17,176 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:39:17,178 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:39:17,180 copying lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:39:17,182 copying lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:39:17,184 copying lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:39:17,186 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:39:17,188 copying lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:39:17,190 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:39:17,192 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:39:17,194 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:17,197 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:17,199 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:17,201 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:17,203 copying lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:17,205 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:17,208 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:17,210 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:17,212 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,215 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,217 copying lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,219 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,221 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,224 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,226 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,228 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,230 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:17,232 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:39:17,234 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:39:17,237 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:39:17,239 copying lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:39:17,241 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:39:17,243 copying lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:39:17,245 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:39:17,247 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:39:17,249 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:39:17,252 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:39:17,254 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:39:17,256 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:39:17,258 copying lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:39:17,261 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:39:17,263 copying lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:39:17,265 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:39:17,268 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:39:17,270 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:39:17,272 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:39:17,274 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:39:17,277 copying lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:39:17,279 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:39:17,281 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:39:17,283 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:39:17,286 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:39:17,288 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:39:17,290 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:39:17,292 copying lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:39:17,294 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:39:17,296 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:39:17,299 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:39:17,301 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:39:17,303 copying lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:39:17,306 copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:39:17,308 copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:39:17,310 copying lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:39:17,313 copying lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:39:17,315 copying lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:39:17,317 copying lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:39:17,320 copying lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:39:17,322 copying lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:39:17,324 copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:39:17,327 copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:39:17,329 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,331 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,334 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,336 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,338 copying lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,340 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,343 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,345 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,347 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:17,349 copying lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:39:17,351 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:39:17,354 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:39:17,356 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:39:17,358 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:39:17,360 copying lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:39:17,362 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:39:17,365 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:39:17,367 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:39:17,369 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,371 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,374 copying lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,376 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,378 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,381 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,383 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,385 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,387 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:17,390 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:39:17,392 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:39:17,394 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:39:17,396 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:39:17,399 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:39:17,401 copying lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:39:17,403 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:39:17,405 copying lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:39:17,408 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:39:17,410 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:39:17,412 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:39:17,415 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:39:17,417 copying lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:39:17,419 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:39:17,422 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:39:17,424 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:39:17,427 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:39:17,429 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:39:17,431 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:39:17,434 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:39:17,436 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:39:17,439 copying lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:39:17,441 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:39:17,444 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:39:17,446 copying lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:39:17,448 copying lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:39:17,451 copying lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:39:17,453 copying lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:39:17,455 copying lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:39:17,458 copying lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:39:17,460 copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:39:17,462 copying lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:39:17,465 copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:39:17,467 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:39:17,470 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:39:17,472 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:39:17,474 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:39:17,477 copying lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:39:17,479 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:39:17,481 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:39:17,483 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:39:17,486 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:39:17,488 copying lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:39:17,490 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:39:17,493 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:39:17,495 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:39:17,497 copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:39:17,500 copying lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:39:17,502 copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:39:17,504 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:39:17,507 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:39:17,509 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:39:17,511 copying lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:39:17,514 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:39:17,516 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:39:17,518 copying lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:39:17,521 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:39:17,523 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:39:17,525 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:39:17,527 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:39:17,530 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:39:17,532 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:39:17,534 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:39:17,537 copying lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:39:17,539 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:39:17,541 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:39:17,544 copying lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:39:17,546 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:39:17,548 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:39:17,551 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:39:17,553 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:39:17,555 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:39:17,558 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:39:17,560 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:39:17,562 copying lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:39:17,565 copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:39:17,567 copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:39:17,569 copying lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:39:17,571 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:39:17,574 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:39:17,576 copying lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:39:17,578 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:39:17,580 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:39:17,583 copying lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:39:17,585 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:39:17,588 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:39:17,590 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:39:17,592 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:39:17,594 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:39:17,597 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:39:17,599 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:39:17,601 copying lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:39:17,604 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:39:17,606 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:39:17,609 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:39:17,612 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:39:17,615 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:39:17,618 copying lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:39:17,621 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:39:17,624 copying lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:39:17,627 copying lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:39:17,629 copying lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:39:17,632 copying lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:39:17,635 copying lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:39:17,638 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:39:17,641 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:39:17,643 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:39:17,646 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:39:17,649 copying lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:39:17,652 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:39:17,654 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:39:17,658 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:39:17,660 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:39:17,663 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:39:17,666 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:39:17,669 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:39:17,672 copying lm_eval/tasks/include/default/North Macedonian/_include_base_44_north_macedonian.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:39:17,675 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:39:17,678 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:39:17,681 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:39:17,684 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:39:17,687 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:39:17,690 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:39:17,693 copying lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:39:17,696 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:39:17,699 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:39:17,701 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:39:17,704 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:39:17,707 copying lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:39:17,709 copying lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:39:17,712 copying lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:39:17,714 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:39:17,716 copying lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:39:17,719 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:39:17,721 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:39:17,723 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:17,726 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:17,728 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:17,730 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:17,733 copying lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:17,735 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:17,738 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:17,740 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:17,742 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,745 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,747 copying lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,750 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,752 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,754 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,756 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,759 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,761 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:17,763 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:39:17,766 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:39:17,768 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:39:17,770 copying lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:39:17,772 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:39:17,775 copying lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:39:17,777 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:39:17,779 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:39:17,782 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:39:17,784 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:39:17,786 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:39:17,789 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:39:17,791 copying lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:39:17,794 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:39:17,796 copying lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:39:17,798 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:39:17,801 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:39:17,803 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:39:17,805 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:39:17,808 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:39:17,810 copying lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:39:17,812 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:39:17,815 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:39:17,817 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:39:17,819 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:39:17,821 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:39:17,824 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:39:17,826 copying lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:39:17,828 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:39:17,831 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:39:17,833 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:39:17,835 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:39:17,837 copying lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:39:17,840 copying lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:39:17,842 copying lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:39:17,844 copying lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:39:17,847 copying lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:39:17,849 copying lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:39:17,851 copying lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:39:17,854 copying lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:39:17,856 copying lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:39:17,858 copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:39:17,860 copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:39:17,863 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,865 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,868 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,870 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,872 copying lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,874 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,877 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,879 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,881 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:17,883 copying lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:39:17,886 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:39:17,888 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:39:17,890 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:39:17,893 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:39:17,895 copying lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,897 copying lm_eval/tasks/longbench/musique.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,900 copying lm_eval/tasks/longbench/_longbench_multi.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,902 copying lm_eval/tasks/longbench/repobench-p.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,904 copying lm_eval/tasks/longbench/multi_news_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,907 copying lm_eval/tasks/longbench/_longbench_code.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,909 copying lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,911 copying lm_eval/tasks/longbench/passage_count_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,914 copying lm_eval/tasks/longbench/_longbench_multi_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,916 copying lm_eval/tasks/longbench/multi_news.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,918 copying lm_eval/tasks/longbench/gov_report.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,921 copying lm_eval/tasks/longbench/_longbench_synthetic_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,923 copying lm_eval/tasks/longbench/_longbench_synthetic.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,925 copying lm_eval/tasks/longbench/_longbench.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,928 copying lm_eval/tasks/longbench/qasper_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,930 copying lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,932 copying lm_eval/tasks/longbench/repobench-p_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,935 copying lm_eval/tasks/longbench/lsht.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,937 copying lm_eval/tasks/longbench/qmsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,940 copying lm_eval/tasks/longbench/qasper.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,942 copying lm_eval/tasks/longbench/_longbench_summarization_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,944 copying lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,946 copying lm_eval/tasks/longbench/hotpotqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,949 copying lm_eval/tasks/longbench/triviaqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,951 copying lm_eval/tasks/longbench/vcsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,953 copying lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,956 copying lm_eval/tasks/longbench/trec.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,958 copying lm_eval/tasks/longbench/lcc_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,960 copying lm_eval/tasks/longbench/_longbench_fewshot.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,962 copying lm_eval/tasks/longbench/gov_report_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,965 copying lm_eval/tasks/longbench/_longbench_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,967 copying lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,969 copying lm_eval/tasks/longbench/triviaqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,972 copying lm_eval/tasks/longbench/lcc.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,974 copying lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,976 copying lm_eval/tasks/longbench/_longbench_fewshot_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,979 copying lm_eval/tasks/longbench/samsum_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,981 copying lm_eval/tasks/longbench/2wikimqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,983 copying lm_eval/tasks/longbench/_longbench_code_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,986 copying lm_eval/tasks/longbench/_longbench_single.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,988 copying lm_eval/tasks/longbench/narrativeqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,990 copying lm_eval/tasks/longbench/samsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,993 copying lm_eval/tasks/longbench/_longbench_summarization.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,995 copying lm_eval/tasks/longbench/dureader.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:17,998 copying lm_eval/tasks/longbench/trec_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:18,000 copying lm_eval/tasks/longbench/passage_count.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:18,002 copying lm_eval/tasks/longbench/_longbench_single_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:18,005 copying lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:18,007 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,009 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,012 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,014 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,017 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,019 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,022 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,024 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,026 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,029 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,031 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,033 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,035 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,038 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,040 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,042 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,045 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,047 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,050 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,052 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,055 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,057 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,060 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,062 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,064 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,067 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,069 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,072 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,074 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,076 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:18,079 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,081 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,084 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,086 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,088 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,091 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,093 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,095 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,097 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,100 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,102 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,104 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,107 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,109 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,112 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,114 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,116 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,119 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,121 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,123 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,126 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,128 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,130 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,133 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,135 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,138 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,140 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,142 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,145 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,147 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,150 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,152 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,154 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,157 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:18,159 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,161 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,163 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,166 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,168 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,170 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,172 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,175 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,177 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,179 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,181 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,184 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,186 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,188 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,190 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,193 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,195 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,198 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,200 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,203 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,205 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,208 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,210 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,212 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,215 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,217 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,220 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,222 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,224 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,228 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,230 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,232 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,235 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,237 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,240 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,242 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,244 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,247 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,249 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,251 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,253 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,256 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,258 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,261 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,263 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,265 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,268 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,271 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,273 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,277 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,280 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,283 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,285 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,287 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,290 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,292 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,295 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,297 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,299 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,302 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,304 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,306 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:18,308 copying lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,311 copying lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,313 copying lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,315 copying lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,318 copying lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,320 copying lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,322 copying lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,325 copying lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,327 copying lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,329 copying lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,332 copying lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,334 copying lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,336 copying lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,339 copying lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,341 copying lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,344 copying lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,346 copying lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,349 copying lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,351 copying lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,353 copying lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,356 copying lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,358 copying lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,360 copying lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,363 copying lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,365 copying lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,368 copying lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,370 copying lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,372 copying lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,375 copying lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,377 copying lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,379 copying lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:18,382 copying lm_eval/tasks/kobest/kobest_boolq.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:39:18,384 copying lm_eval/tasks/kobest/kobest_wic.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:39:18,386 copying lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:39:18,389 copying lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:39:18,391 copying lm_eval/tasks/kobest/kobest_copa.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:39:18,394 copying lm_eval/tasks/kobest/_kobest.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:39:18,396 copying lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/lib/lm_eval/tasks/realtoxicityprompts 2026-09-01T00:39:18,399 copying lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:39:18,401 copying lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:39:18,403 copying lm_eval/tasks/portuguese_bench/assin2_sts.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:39:18,406 copying lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:39:18,408 copying lm_eval/tasks/portuguese_bench/assin2_rte.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:39:18,411 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,413 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,416 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,418 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,421 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,423 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,425 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,428 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,430 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,432 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,435 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,437 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,439 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,442 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,444 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,447 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,449 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:18,451 creating build/lib/lm_eval/tasks/wmdp 2026-09-01T00:39:18,453 copying lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:39:18,455 copying lm_eval/tasks/wmdp/_wmdp.yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:39:18,458 copying lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:39:18,460 copying lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:39:18,463 copying lm_eval/tasks/longproc/travel_planning_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,465 copying lm_eval/tasks/longproc/html_to_tsv_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,468 copying lm_eval/tasks/longproc/tom_tracking_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,470 copying lm_eval/tasks/longproc/pseudo_to_code_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,472 copying lm_eval/tasks/longproc/tom_tracking_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,475 copying lm_eval/tasks/longproc/path_traversal_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,477 copying lm_eval/tasks/longproc/_longproc_countdown.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,479 copying lm_eval/tasks/longproc/_longproc_tom_tracking.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,482 copying lm_eval/tasks/longproc/countdown_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,484 copying lm_eval/tasks/longproc/tom_tracking_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,487 copying lm_eval/tasks/longproc/path_traversal_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,489 copying lm_eval/tasks/longproc/countdown_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,491 copying lm_eval/tasks/longproc/_longproc.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,494 copying lm_eval/tasks/longproc/_longproc_pseudo_to_code.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,496 copying lm_eval/tasks/longproc/_longproc_html_to_tsv.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,499 copying lm_eval/tasks/longproc/_longproc_path_traversal.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,502 copying lm_eval/tasks/longproc/countdown_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,504 copying lm_eval/tasks/longproc/html_to_tsv_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,507 copying lm_eval/tasks/longproc/travel_planning_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,509 copying lm_eval/tasks/longproc/html_to_tsv_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,511 copying lm_eval/tasks/longproc/_longproc_travel_planning.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,514 copying lm_eval/tasks/longproc/path_traversal_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,516 copying lm_eval/tasks/longproc/pseudo_to_code_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:18,518 creating build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,519 copying lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,522 copying lm_eval/tasks/pile/pile_github.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,524 copying lm_eval/tasks/pile/pile_enron.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,527 copying lm_eval/tasks/pile/pile_uspto.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,529 copying lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,531 copying lm_eval/tasks/pile/pile_books3.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,534 copying lm_eval/tasks/pile/pile_pile-cc.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,536 copying lm_eval/tasks/pile/pile_hackernews.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,538 copying lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,540 copying lm_eval/tasks/pile/pile_europarl.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,543 copying lm_eval/tasks/pile/pile_arxiv.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,545 copying lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,547 copying lm_eval/tasks/pile/pile_philpapers.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,550 copying lm_eval/tasks/pile/pile_gutenberg.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,552 copying lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,554 copying lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,557 copying lm_eval/tasks/pile/pile_stackexchange.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,559 copying lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,561 copying lm_eval/tasks/pile/pile_freelaw.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,564 copying lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,566 copying lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,568 copying lm_eval/tasks/pile/pile_wikipedia.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:18,570 creating build/lib/lm_eval/tasks/commonsense_qa 2026-09-01T00:39:18,572 copying lm_eval/tasks/commonsense_qa/default.yaml -> build/lib/lm_eval/tasks/commonsense_qa 2026-09-01T00:39:18,574 copying lm_eval/tasks/mathqa/mathqa.yaml -> build/lib/lm_eval/tasks/mathqa 2026-09-01T00:39:18,577 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,579 copying lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,582 copying lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,584 copying lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,587 copying lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,589 copying lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,591 copying lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,594 copying lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,596 copying lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,598 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,601 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,603 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,605 copying lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,608 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,610 copying lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,612 copying lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,614 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,617 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,619 copying lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,621 copying lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,624 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,626 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,628 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,631 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,633 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,636 copying lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,638 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,640 copying lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,643 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,645 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,647 copying lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,650 copying lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,652 copying lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,654 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,657 copying lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,659 copying lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,661 copying lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,664 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,666 copying lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,668 copying lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,670 copying lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,673 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,675 copying lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,677 copying lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,680 copying lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,682 copying lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,684 copying lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,687 copying lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,689 copying lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,691 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,694 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,696 copying lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,699 copying lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,701 copying lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,703 copying lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,706 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,708 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,710 copying lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,713 copying lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,715 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,718 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,720 copying lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,722 copying lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,725 copying lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,727 copying lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,729 copying lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,732 copying lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,734 copying lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,736 copying lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,739 copying lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,741 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,743 copying lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:18,746 creating build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:39:18,747 copying lm_eval/tasks/benchmarks/pythia.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:39:18,749 copying lm_eval/tasks/benchmarks/minerva_math.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:39:18,752 copying lm_eval/tasks/benchmarks/t0_eval.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:39:18,754 copying lm_eval/tasks/benchmarks/openllm.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:39:18,756 creating build/lib/lm_eval/tasks/benchmarks/flan 2026-09-01T00:39:18,758 copying lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-09-01T00:39:18,761 copying lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-09-01T00:39:18,763 creating build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:39:18,764 copying lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:39:18,767 copying lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,769 copying lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,771 copying lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,774 copying lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,776 copying lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,778 copying lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,781 copying lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,783 copying lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,785 copying lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,788 copying lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,790 copying lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,792 copying lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,794 copying lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,797 copying lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,799 copying lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,801 copying lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,803 copying lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,806 copying lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,808 copying lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,810 copying lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,812 copying lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,814 copying lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:18,817 creating build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,818 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,820 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,822 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,825 copying lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,827 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,830 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,832 copying lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,834 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,837 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,839 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,841 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,844 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,846 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,849 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,851 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,853 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:18,856 copying lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/lib/lm_eval/tasks/darijahellaswag 2026-09-01T00:39:18,858 creating build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:39:18,860 copying lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:39:18,862 creating build/lib/lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:39:18,863 copying lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:39:18,866 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,868 copying lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,871 copying lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,873 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,875 copying lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,877 copying lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,880 copying lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,882 copying lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,884 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,887 copying lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,889 copying lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,891 copying lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,893 copying lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,896 copying lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,898 copying lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,900 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,903 copying lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,905 copying lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,908 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,910 copying lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,912 copying lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,914 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,917 copying lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,919 copying lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,922 copying lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,924 copying lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,926 copying lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,929 copying lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:18,931 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,934 copying lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,936 copying lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,939 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,941 copying lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,943 copying lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,946 copying lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,948 copying lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,950 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,953 copying lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,955 copying lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,957 copying lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,959 copying lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,962 copying lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,964 copying lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,967 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,969 copying lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,972 copying lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,974 copying lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,977 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,979 copying lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,981 copying lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,984 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,986 copying lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,989 copying lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,991 copying lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,993 copying lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,996 copying lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:18,998 creating build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:18,999 copying lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,002 copying lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,004 copying lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,007 copying lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,009 copying lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,011 copying lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,014 copying lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,016 copying lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,019 copying lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,021 copying lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,024 copying lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,026 copying lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,028 copying lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,030 copying lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,033 copying lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,035 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,037 copying lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,040 copying lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,042 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,044 copying lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,047 copying lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,049 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,051 copying lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,054 copying lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,056 copying lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,059 copying lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,061 copying lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,064 copying lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:19,066 creating build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,067 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,069 copying lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,072 copying lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,074 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,077 copying lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,080 copying lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,082 copying lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,085 copying lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,088 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,090 copying lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,093 copying lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,096 copying lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,099 copying lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,101 copying lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,104 copying lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,106 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,109 copying lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,111 copying lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,113 copying lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,116 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,118 copying lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,120 copying lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,123 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,125 copying lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,128 copying lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,131 copying lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,133 copying lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,135 copying lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,138 copying lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:19,140 copying lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/lib/lm_eval/tasks/med_text_classification 2026-09-01T00:39:19,143 copying lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/lib/lm_eval/tasks/med_text_classification 2026-09-01T00:39:19,145 copying lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml -> build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:39:19,147 copying lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml -> build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:39:19,150 copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,152 copying lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,154 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,157 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,159 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,161 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,164 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,166 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,169 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,171 copying lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,173 copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,175 copying lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,178 copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,180 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,182 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,184 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,186 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,189 copying lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,191 copying lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,193 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,195 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,198 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,200 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,202 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,204 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,207 copying lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,209 copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,211 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,214 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,216 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,218 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,221 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,223 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,225 copying lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,227 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,230 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,232 copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,234 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,237 copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,239 copying lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,241 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,244 copying lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,246 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,248 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,250 copying lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,252 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:19,255 creating build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:39:19,256 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:39:19,258 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:39:19,261 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:39:19,263 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,265 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,268 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,270 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,272 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,274 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,277 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,279 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,282 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,284 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,286 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,288 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,291 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,293 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,296 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,298 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,301 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,303 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,305 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,307 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,310 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,312 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,314 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,316 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,319 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,321 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,323 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,326 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,328 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,330 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,333 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,335 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,338 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,340 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,342 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,344 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,347 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,349 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,351 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,354 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,356 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,358 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,360 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,363 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,365 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,368 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,370 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,372 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,375 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:19,377 copying lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,380 copying lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,382 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,384 copying lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,387 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,389 copying lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,391 copying lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,394 copying lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,396 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,398 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,401 copying lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,403 copying lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,405 copying lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,407 copying lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,410 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,412 copying lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,414 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,417 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,419 copying lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,421 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,423 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,426 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,428 copying lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,430 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,433 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,435 copying lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,437 copying lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,440 copying lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,442 copying lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,444 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,447 copying lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,449 copying lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,451 copying lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,454 copying lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,456 copying lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,458 copying lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,461 copying lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,463 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,465 copying lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,467 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,470 copying lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,472 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,474 copying lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,477 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,479 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,481 copying lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,483 copying lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,486 copying lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,488 copying lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,490 copying lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,493 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,495 copying lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,497 copying lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,500 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,502 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,504 copying lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,506 copying lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,509 copying lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,511 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,514 copying lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,516 copying lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,518 copying lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,520 copying lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,522 copying lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,525 copying lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,527 copying lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,529 copying lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,532 copying lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,534 copying lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,536 copying lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,539 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,541 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,543 copying lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,546 copying lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,548 copying lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,550 copying lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,553 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,555 copying lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,557 copying lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,560 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,562 copying lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,564 copying lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,567 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,569 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,571 copying lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,574 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,576 copying lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,578 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,581 copying lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,583 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,585 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,588 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,590 copying lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,592 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,595 copying lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,597 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,600 copying lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,602 copying lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,604 copying lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,607 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,609 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,612 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,614 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,617 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,619 copying lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,622 copying lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,624 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,627 copying lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,629 copying lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,631 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,634 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,636 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,638 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,641 copying lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,643 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,645 copying lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,648 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,651 copying lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,653 copying lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,656 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,658 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,660 copying lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,663 copying lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,665 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,668 copying lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,670 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,672 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,675 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,677 copying lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,680 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,682 copying lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,684 copying lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,687 copying lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,689 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,692 copying lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:19,694 creating build/lib/lm_eval/tasks/super_glue/boolq 2026-09-01T00:39:19,695 copying lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-09-01T00:39:19,698 copying lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-09-01T00:39:19,700 copying lm_eval/tasks/super_glue/boolq/default.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-09-01T00:39:19,703 creating build/lib/lm_eval/tasks/super_glue/rte 2026-09-01T00:39:19,704 copying lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2026-09-01T00:39:19,706 copying lm_eval/tasks/super_glue/rte/default.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2026-09-01T00:39:19,708 copying lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:39:19,711 copying lm_eval/tasks/super_glue/wsc/default.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:39:19,713 copying lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:39:19,716 copying lm_eval/tasks/super_glue/cb/default.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:39:19,718 creating build/lib/lm_eval/tasks/super_glue/wic 2026-09-01T00:39:19,719 copying lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2026-09-01T00:39:19,721 copying lm_eval/tasks/super_glue/wic/default.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2026-09-01T00:39:19,724 copying lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:39:19,726 copying lm_eval/tasks/super_glue/record/default.yaml -> build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:39:19,729 copying lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2026-09-01T00:39:19,731 copying lm_eval/tasks/super_glue/multirc/default.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2026-09-01T00:39:19,733 copying lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2026-09-01T00:39:19,736 copying lm_eval/tasks/super_glue/copa/default.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2026-09-01T00:39:19,738 copying lm_eval/tasks/toxigen/toxigen.yaml -> build/lib/lm_eval/tasks/toxigen 2026-09-01T00:39:19,741 copying lm_eval/tasks/eus_reading/eus_reading.yaml -> build/lib/lm_eval/tasks/eus_reading 2026-09-01T00:39:19,743 copying lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,745 copying lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,748 copying lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,750 copying lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,752 copying lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,755 copying lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,757 copying lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,759 copying lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,762 copying lm_eval/tasks/ceval/_ceval-valid.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,764 copying lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,766 copying lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,768 copying lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,770 copying lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,772 copying lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,775 copying lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,777 copying lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,779 copying lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,781 copying lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,783 copying lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,786 copying lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,788 copying lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,790 copying lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,793 copying lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,795 copying lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,798 copying lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,800 copying lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,802 copying lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,805 copying lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,807 copying lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,809 copying lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,811 copying lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,814 copying lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,816 copying lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,818 copying lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,821 copying lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,823 copying lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,826 copying lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,828 copying lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,831 copying lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,833 copying lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,835 copying lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,838 copying lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,840 copying lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,842 copying lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,844 copying lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,847 copying lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,849 copying lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,851 copying lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,854 copying lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,856 copying lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,859 copying lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,861 copying lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,863 copying lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:19,865 creating build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,866 copying lm_eval/tasks/mela/mela_ja.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,869 copying lm_eval/tasks/mela/mela_ar.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,871 copying lm_eval/tasks/mela/mela_zh.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,873 copying lm_eval/tasks/mela/mela_de.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,876 copying lm_eval/tasks/mela/_mela.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,878 copying lm_eval/tasks/mela/mela_es.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,880 copying lm_eval/tasks/mela/mela_en.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,883 copying lm_eval/tasks/mela/mela_fr.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,885 copying lm_eval/tasks/mela/mela_is.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,887 copying lm_eval/tasks/mela/mela_ru.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,890 copying lm_eval/tasks/mela/mela_it.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:19,892 creating build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:19,893 copying lm_eval/tasks/aexams/aexams_Physics.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:19,896 copying lm_eval/tasks/aexams/aexams_Science.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:19,898 copying lm_eval/tasks/aexams/_aexams.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:19,900 copying lm_eval/tasks/aexams/aexams_Biology.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:19,903 copying lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:19,905 copying lm_eval/tasks/aexams/aexams_Social.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:19,907 creating build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,909 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,911 copying lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,913 copying lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,916 copying lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,918 copying lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,920 copying lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,922 copying lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,925 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,927 copying lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,929 copying lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,931 copying lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,933 copying lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:19,936 creating build/lib/lm_eval/tasks/triviaqa 2026-09-01T00:39:19,937 copying lm_eval/tasks/triviaqa/default.yaml -> build/lib/lm_eval/tasks/triviaqa 2026-09-01T00:39:19,939 creating build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:19,941 copying lm_eval/tasks/haerae/haerae_lw.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:19,943 copying lm_eval/tasks/haerae/haerae_hi.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:19,945 copying lm_eval/tasks/haerae/haerae_gk.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:19,948 copying lm_eval/tasks/haerae/haerae_rw.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:19,950 copying lm_eval/tasks/haerae/_haerae.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:19,952 copying lm_eval/tasks/haerae/haerae_sn.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:19,954 creating build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:39:19,955 copying lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:39:19,958 copying lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:39:19,960 copying lm_eval/tasks/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:39:19,963 copying lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:39:19,965 copying lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:39:19,967 copying lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:39:19,970 copying lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:39:19,972 copying lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:39:19,974 copying lm_eval/tasks/basqueglue/bhtc.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:39:19,977 copying lm_eval/tasks/basqueglue/bec.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:39:19,979 copying lm_eval/tasks/basqueglue/wic.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:39:19,981 copying lm_eval/tasks/basqueglue/coref.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:39:19,983 copying lm_eval/tasks/basqueglue/vaxx.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:39:19,986 copying lm_eval/tasks/basqueglue/qnli.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:39:19,988 copying lm_eval/tasks/coqa/default.yaml -> build/lib/lm_eval/tasks/coqa 2026-09-01T00:39:19,991 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2026-09-01T00:39:19,993 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:19,995 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:19,998 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,000 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,002 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,004 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,007 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,009 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,011 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,013 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,016 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,018 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,020 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,022 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,024 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,027 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,029 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:20,031 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,034 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,036 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,038 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,040 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,043 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,045 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,047 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,049 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,052 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,054 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,056 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,059 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,061 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,063 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,065 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,067 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:20,070 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,072 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,074 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,076 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,078 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,081 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,083 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,085 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,087 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,090 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,092 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,094 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,096 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,099 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,101 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,103 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,105 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:20,108 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,110 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,112 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,115 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,117 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,119 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,121 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,124 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,126 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,128 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,130 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,132 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,135 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,137 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,139 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,141 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,144 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:20,146 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,148 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,151 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,153 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,155 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,157 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,160 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,162 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,164 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,167 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,169 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,171 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,173 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,176 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,178 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,180 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,182 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:20,186 copying lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2026-09-01T00:39:20,188 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,190 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,192 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,195 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,197 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,199 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,202 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,204 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,206 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,209 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,211 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,213 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,216 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,218 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,221 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,223 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,225 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,228 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:20,230 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,233 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,235 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,237 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,240 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,242 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,244 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,247 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,249 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,251 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,253 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,256 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,258 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,260 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,262 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,265 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,267 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,269 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:20,272 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,274 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,277 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,279 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,281 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,283 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,286 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,288 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,291 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,293 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,295 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,298 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,300 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,302 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,305 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,307 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,309 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,312 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:20,314 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,316 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,318 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,320 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,323 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,325 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,327 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,330 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,332 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,334 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,337 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,339 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,341 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,343 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,346 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,348 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,351 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,353 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:20,355 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,358 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,360 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,362 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,365 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,367 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,370 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,372 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,374 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,377 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,379 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,381 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,384 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,386 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,388 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,390 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,393 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,395 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:20,397 creating build/lib/lm_eval/tasks/headqa 2026-09-01T00:39:20,399 copying lm_eval/tasks/headqa/headqa_en.yaml -> build/lib/lm_eval/tasks/headqa 2026-09-01T00:39:20,401 copying lm_eval/tasks/headqa/headqa_es.yaml -> build/lib/lm_eval/tasks/headqa 2026-09-01T00:39:20,403 copying lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:39:20,406 copying lm_eval/tasks/humaneval/humaneval.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:39:20,408 copying lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:39:20,410 copying lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:39:20,413 copying lm_eval/tasks/humaneval/humaneval_64.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:39:20,415 creating build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:39:20,416 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:39:20,419 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:39:20,421 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:39:20,423 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:39:20,426 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:39:20,429 copying lm_eval/tasks/score/score_robustness.yaml -> build/lib/lm_eval/tasks/score 2026-09-01T00:39:20,431 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,434 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,436 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,438 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,441 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,443 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,445 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,447 copying lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,450 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,452 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,454 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,457 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,459 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,461 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,463 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,466 copying lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,468 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,471 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,473 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,475 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,478 copying lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,480 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,482 copying lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,485 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,487 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:20,490 copying lm_eval/tasks/score/math/score_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,492 copying lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,494 copying lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,497 copying lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,499 copying lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,501 copying lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,504 copying lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,507 copying lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,509 copying lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,511 copying lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,514 copying lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,516 copying lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,519 copying lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,521 copying lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,523 copying lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,526 copying lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,528 copying lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:20,531 copying lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:39:20,534 copying lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:39:20,537 copying lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:39:20,540 copying lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,543 copying lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,546 copying lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,549 copying lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,551 copying lm_eval/tasks/spanish_bench/copa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,554 copying lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,557 copying lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,560 copying lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,563 copying lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,566 copying lm_eval/tasks/spanish_bench/escola.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:20,569 copying lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,572 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,575 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,578 copying lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,581 copying lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,583 copying lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,587 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,590 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,592 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,595 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,598 copying lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,601 copying lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,603 copying lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,606 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,609 copying lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,612 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,615 copying lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:20,617 creating build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:39:20,619 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:39:20,622 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:39:20,625 copying lm_eval/tasks/careqa/careqa_en.yaml -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:39:20,627 copying lm_eval/tasks/careqa/careqa_es.yaml -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:39:20,630 copying lm_eval/tasks/careqa/careqa_open.yaml -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:39:20,632 copying lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:39:20,634 creating build/lib/lm_eval/tasks/piqa 2026-09-01T00:39:20,636 copying lm_eval/tasks/piqa/piqa.yaml -> build/lib/lm_eval/tasks/piqa 2026-09-01T00:39:20,638 copying lm_eval/tasks/global_piqa/_global_piqa_cloze.yaml -> build/lib/lm_eval/tasks/global_piqa 2026-09-01T00:39:20,641 copying lm_eval/tasks/global_piqa/_global_piqa_generation.yaml -> build/lib/lm_eval/tasks/global_piqa 2026-09-01T00:39:20,643 copying lm_eval/tasks/global_piqa/parallel_generation/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,645 copying lm_eval/tasks/global_piqa/parallel_generation/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,648 copying lm_eval/tasks/global_piqa/parallel_generation/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,650 copying lm_eval/tasks/global_piqa/parallel_generation/_global_piqa_parallel_generation.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,653 copying lm_eval/tasks/global_piqa/parallel_generation/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,655 copying lm_eval/tasks/global_piqa/parallel_generation/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,658 copying lm_eval/tasks/global_piqa/parallel_generation/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,660 copying lm_eval/tasks/global_piqa/parallel_generation/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,662 copying lm_eval/tasks/global_piqa/parallel_generation/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,665 copying lm_eval/tasks/global_piqa/parallel_generation/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,667 copying lm_eval/tasks/global_piqa/parallel_generation/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,669 copying lm_eval/tasks/global_piqa/parallel_generation/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,671 copying lm_eval/tasks/global_piqa/parallel_generation/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,674 copying lm_eval/tasks/global_piqa/parallel_generation/eus_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,676 copying lm_eval/tasks/global_piqa/parallel_generation/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,678 copying lm_eval/tasks/global_piqa/parallel_generation/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,681 copying lm_eval/tasks/global_piqa/parallel_generation/tel_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,683 copying lm_eval/tasks/global_piqa/parallel_generation/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,685 copying lm_eval/tasks/global_piqa/parallel_generation/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,688 copying lm_eval/tasks/global_piqa/parallel_generation/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,690 copying lm_eval/tasks/global_piqa/parallel_generation/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,692 copying lm_eval/tasks/global_piqa/parallel_generation/kan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,694 copying lm_eval/tasks/global_piqa/parallel_generation/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,697 copying lm_eval/tasks/global_piqa/parallel_generation/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,699 copying lm_eval/tasks/global_piqa/parallel_generation/mag_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,701 copying lm_eval/tasks/global_piqa/parallel_generation/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,704 copying lm_eval/tasks/global_piqa/parallel_generation/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,706 copying lm_eval/tasks/global_piqa/parallel_generation/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,708 copying lm_eval/tasks/global_piqa/parallel_generation/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,711 copying lm_eval/tasks/global_piqa/parallel_generation/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,713 copying lm_eval/tasks/global_piqa/parallel_generation/srp_latn_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,715 copying lm_eval/tasks/global_piqa/parallel_generation/xho_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,718 copying lm_eval/tasks/global_piqa/parallel_generation/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,720 copying lm_eval/tasks/global_piqa/parallel_generation/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,722 copying lm_eval/tasks/global_piqa/parallel_generation/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,725 copying lm_eval/tasks/global_piqa/parallel_generation/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,728 copying lm_eval/tasks/global_piqa/parallel_generation/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,730 copying lm_eval/tasks/global_piqa/parallel_generation/bgc_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,732 copying lm_eval/tasks/global_piqa/parallel_generation/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,735 copying lm_eval/tasks/global_piqa/parallel_generation/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,737 copying lm_eval/tasks/global_piqa/parallel_generation/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,739 copying lm_eval/tasks/global_piqa/parallel_generation/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,741 copying lm_eval/tasks/global_piqa/parallel_generation/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,744 copying lm_eval/tasks/global_piqa/parallel_generation/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,746 copying lm_eval/tasks/global_piqa/parallel_generation/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,749 copying lm_eval/tasks/global_piqa/parallel_generation/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,751 copying lm_eval/tasks/global_piqa/parallel_generation/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,753 copying lm_eval/tasks/global_piqa/parallel_generation/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,756 copying lm_eval/tasks/global_piqa/parallel_generation/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,758 copying lm_eval/tasks/global_piqa/parallel_generation/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,760 copying lm_eval/tasks/global_piqa/parallel_generation/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,763 copying lm_eval/tasks/global_piqa/parallel_generation/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,765 copying lm_eval/tasks/global_piqa/parallel_generation/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,768 copying lm_eval/tasks/global_piqa/parallel_generation/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,770 copying lm_eval/tasks/global_piqa/parallel_generation/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,773 copying lm_eval/tasks/global_piqa/parallel_generation/hin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,775 copying lm_eval/tasks/global_piqa/parallel_generation/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,777 copying lm_eval/tasks/global_piqa/parallel_generation/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,780 copying lm_eval/tasks/global_piqa/parallel_generation/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,782 copying lm_eval/tasks/global_piqa/parallel_generation/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,785 copying lm_eval/tasks/global_piqa/parallel_generation/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,787 copying lm_eval/tasks/global_piqa/parallel_generation/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,789 copying lm_eval/tasks/global_piqa/parallel_generation/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,792 copying lm_eval/tasks/global_piqa/parallel_generation/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,794 copying lm_eval/tasks/global_piqa/parallel_generation/bra_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,796 copying lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,798 copying lm_eval/tasks/global_piqa/parallel_generation/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,801 copying lm_eval/tasks/global_piqa/parallel_generation/bcc_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,803 copying lm_eval/tasks/global_piqa/parallel_generation/swv_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,805 copying lm_eval/tasks/global_piqa/parallel_generation/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,808 copying lm_eval/tasks/global_piqa/parallel_generation/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,810 copying lm_eval/tasks/global_piqa/parallel_generation/plt_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,813 copying lm_eval/tasks/global_piqa/parallel_generation/ceb_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,815 copying lm_eval/tasks/global_piqa/parallel_generation/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,818 copying lm_eval/tasks/global_piqa/parallel_generation/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,820 copying lm_eval/tasks/global_piqa/parallel_generation/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,822 copying lm_eval/tasks/global_piqa/parallel_generation/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,825 copying lm_eval/tasks/global_piqa/parallel_generation/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,827 copying lm_eval/tasks/global_piqa/parallel_generation/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,829 copying lm_eval/tasks/global_piqa/parallel_generation/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,832 copying lm_eval/tasks/global_piqa/parallel_generation/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,834 copying lm_eval/tasks/global_piqa/parallel_generation/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,836 copying lm_eval/tasks/global_piqa/parallel_generation/ory_orya.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,839 copying lm_eval/tasks/global_piqa/parallel_generation/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,841 copying lm_eval/tasks/global_piqa/parallel_generation/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,843 copying lm_eval/tasks/global_piqa/parallel_generation/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,846 copying lm_eval/tasks/global_piqa/parallel_generation/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,848 copying lm_eval/tasks/global_piqa/parallel_generation/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,851 copying lm_eval/tasks/global_piqa/parallel_generation/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,853 copying lm_eval/tasks/global_piqa/parallel_generation/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,856 copying lm_eval/tasks/global_piqa/parallel_generation/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,858 copying lm_eval/tasks/global_piqa/parallel_generation/tam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,861 copying lm_eval/tasks/global_piqa/parallel_generation/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,863 copying lm_eval/tasks/global_piqa/parallel_generation/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,865 copying lm_eval/tasks/global_piqa/parallel_generation/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,867 copying lm_eval/tasks/global_piqa/parallel_generation/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,870 copying lm_eval/tasks/global_piqa/parallel_generation/dan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,872 copying lm_eval/tasks/global_piqa/parallel_generation/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,874 copying lm_eval/tasks/global_piqa/parallel_generation/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,877 copying lm_eval/tasks/global_piqa/parallel_generation/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,879 copying lm_eval/tasks/global_piqa/parallel_generation/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,882 copying lm_eval/tasks/global_piqa/parallel_generation/bxr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,884 copying lm_eval/tasks/global_piqa/parallel_generation/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,887 copying lm_eval/tasks/global_piqa/parallel_generation/cls_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,889 copying lm_eval/tasks/global_piqa/parallel_generation/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,892 copying lm_eval/tasks/global_piqa/parallel_generation/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,894 copying lm_eval/tasks/global_piqa/parallel_generation/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,897 copying lm_eval/tasks/global_piqa/parallel_generation/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,899 copying lm_eval/tasks/global_piqa/parallel_generation/slv_latn_prle.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,902 copying lm_eval/tasks/global_piqa/parallel_generation/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,904 copying lm_eval/tasks/global_piqa/parallel_generation/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,907 copying lm_eval/tasks/global_piqa/parallel_generation/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,909 copying lm_eval/tasks/global_piqa/parallel_generation/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,912 copying lm_eval/tasks/global_piqa/parallel_generation/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,914 copying lm_eval/tasks/global_piqa/parallel_generation/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,916 copying lm_eval/tasks/global_piqa/parallel_generation/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,919 copying lm_eval/tasks/global_piqa/parallel_generation/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,921 copying lm_eval/tasks/global_piqa/parallel_generation/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,924 copying lm_eval/tasks/global_piqa/parallel_generation/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,926 copying lm_eval/tasks/global_piqa/parallel_generation/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,928 copying lm_eval/tasks/global_piqa/parallel_generation/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,931 copying lm_eval/tasks/global_piqa/parallel_generation/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,933 copying lm_eval/tasks/global_piqa/parallel_generation/sin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,935 copying lm_eval/tasks/global_piqa/parallel_generation/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,938 copying lm_eval/tasks/global_piqa/parallel_generation/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,940 copying lm_eval/tasks/global_piqa/parallel_generation/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,942 copying lm_eval/tasks/global_piqa/parallel_generation/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,945 copying lm_eval/tasks/global_piqa/parallel_generation/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,947 copying lm_eval/tasks/global_piqa/parallel_generation/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,950 copying lm_eval/tasks/global_piqa/parallel_generation/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,952 copying lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,954 copying lm_eval/tasks/global_piqa/parallel_generation/ilo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:20,957 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,959 copying lm_eval/tasks/global_piqa/nonparallel_cloze/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,962 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,964 copying lm_eval/tasks/global_piqa/nonparallel_cloze/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,967 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,969 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,971 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ckb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,974 copying lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,976 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,979 copying lm_eval/tasks/global_piqa/nonparallel_cloze/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,981 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,984 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mni_mtei.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,986 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,988 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kaz_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,991 copying lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,993 copying lm_eval/tasks/global_piqa/nonparallel_cloze/eus_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,995 copying lm_eval/tasks/global_piqa/nonparallel_cloze/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:20,998 copying lm_eval/tasks/global_piqa/nonparallel_cloze/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,000 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tel_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,002 copying lm_eval/tasks/global_piqa/nonparallel_cloze/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,005 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,007 copying lm_eval/tasks/global_piqa/nonparallel_cloze/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,009 copying lm_eval/tasks/global_piqa/nonparallel_cloze/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,012 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,014 copying lm_eval/tasks/global_piqa/nonparallel_cloze/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,016 copying lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,019 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,021 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,023 copying lm_eval/tasks/global_piqa/nonparallel_cloze/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,026 copying lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,028 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,031 copying lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,033 copying lm_eval/tasks/global_piqa/nonparallel_cloze/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,035 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,038 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bsk_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,040 copying lm_eval/tasks/global_piqa/nonparallel_cloze/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,043 copying lm_eval/tasks/global_piqa/nonparallel_cloze/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,045 copying lm_eval/tasks/global_piqa/nonparallel_cloze/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,048 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bgc_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,050 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,052 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,054 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,057 copying lm_eval/tasks/global_piqa/nonparallel_cloze/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,059 copying lm_eval/tasks/global_piqa/nonparallel_cloze/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,062 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,064 copying lm_eval/tasks/global_piqa/nonparallel_cloze/luo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,067 copying lm_eval/tasks/global_piqa/nonparallel_cloze/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,069 copying lm_eval/tasks/global_piqa/nonparallel_cloze/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,071 copying lm_eval/tasks/global_piqa/nonparallel_cloze/asm_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,074 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,076 copying lm_eval/tasks/global_piqa/nonparallel_cloze/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,078 copying lm_eval/tasks/global_piqa/nonparallel_cloze/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,081 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,083 copying lm_eval/tasks/global_piqa/nonparallel_cloze/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,086 copying lm_eval/tasks/global_piqa/nonparallel_cloze/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,088 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,090 copying lm_eval/tasks/global_piqa/nonparallel_cloze/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,093 copying lm_eval/tasks/global_piqa/nonparallel_cloze/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,095 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,097 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,100 copying lm_eval/tasks/global_piqa/nonparallel_cloze/_global_piqa_nonparallel_cloze.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,103 copying lm_eval/tasks/global_piqa/nonparallel_cloze/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,105 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,108 copying lm_eval/tasks/global_piqa/nonparallel_cloze/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,110 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,113 copying lm_eval/tasks/global_piqa/nonparallel_cloze/sun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,116 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,118 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,120 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,122 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bra_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,125 copying lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,127 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,129 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bcc_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,132 copying lm_eval/tasks/global_piqa/nonparallel_cloze/swv_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,134 copying lm_eval/tasks/global_piqa/nonparallel_cloze/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,136 copying lm_eval/tasks/global_piqa/nonparallel_cloze/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,139 copying lm_eval/tasks/global_piqa/nonparallel_cloze/plt_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,141 copying lm_eval/tasks/global_piqa/nonparallel_cloze/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,143 copying lm_eval/tasks/global_piqa/nonparallel_cloze/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,146 copying lm_eval/tasks/global_piqa/nonparallel_cloze/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,148 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,150 copying lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,153 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,155 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,158 copying lm_eval/tasks/global_piqa/nonparallel_cloze/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,160 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,162 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ory_orya.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,165 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,167 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,170 copying lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,172 copying lm_eval/tasks/global_piqa/nonparallel_cloze/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,174 copying lm_eval/tasks/global_piqa/nonparallel_cloze/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,177 copying lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,179 copying lm_eval/tasks/global_piqa/nonparallel_cloze/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,181 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,184 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,186 copying lm_eval/tasks/global_piqa/nonparallel_cloze/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,188 copying lm_eval/tasks/global_piqa/nonparallel_cloze/dje_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,191 copying lm_eval/tasks/global_piqa/nonparallel_cloze/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,193 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,195 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,198 copying lm_eval/tasks/global_piqa/nonparallel_cloze/dan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,200 copying lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,203 copying lm_eval/tasks/global_piqa/nonparallel_cloze/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,205 copying lm_eval/tasks/global_piqa/nonparallel_cloze/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,207 copying lm_eval/tasks/global_piqa/nonparallel_cloze/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,210 copying lm_eval/tasks/global_piqa/nonparallel_cloze/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,212 copying lm_eval/tasks/global_piqa/nonparallel_cloze/cls_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,214 copying lm_eval/tasks/global_piqa/nonparallel_cloze/btx_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,217 copying lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,219 copying lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,221 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,224 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,226 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_prle.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,228 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bos_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,231 copying lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,233 copying lm_eval/tasks/global_piqa/nonparallel_cloze/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,235 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,238 copying lm_eval/tasks/global_piqa/nonparallel_cloze/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,240 copying lm_eval/tasks/global_piqa/nonparallel_cloze/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,243 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,245 copying lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,247 copying lm_eval/tasks/global_piqa/nonparallel_cloze/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,249 copying lm_eval/tasks/global_piqa/nonparallel_cloze/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,252 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,254 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,256 copying lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,259 copying lm_eval/tasks/global_piqa/nonparallel_cloze/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,261 copying lm_eval/tasks/global_piqa/nonparallel_cloze/sin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,263 copying lm_eval/tasks/global_piqa/nonparallel_cloze/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,266 copying lm_eval/tasks/global_piqa/nonparallel_cloze/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,268 copying lm_eval/tasks/global_piqa/nonparallel_cloze/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,270 copying lm_eval/tasks/global_piqa/nonparallel_cloze/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,273 copying lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,275 copying lm_eval/tasks/global_piqa/nonparallel_cloze/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,277 copying lm_eval/tasks/global_piqa/nonparallel_cloze/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,280 copying lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:21,282 copying lm_eval/tasks/global_piqa/parallel_cloze/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,284 copying lm_eval/tasks/global_piqa/parallel_cloze/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,287 copying lm_eval/tasks/global_piqa/parallel_cloze/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,289 copying lm_eval/tasks/global_piqa/parallel_cloze/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,291 copying lm_eval/tasks/global_piqa/parallel_cloze/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,294 copying lm_eval/tasks/global_piqa/parallel_cloze/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,296 copying lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,299 copying lm_eval/tasks/global_piqa/parallel_cloze/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,301 copying lm_eval/tasks/global_piqa/parallel_cloze/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,303 copying lm_eval/tasks/global_piqa/parallel_cloze/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,306 copying lm_eval/tasks/global_piqa/parallel_cloze/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,308 copying lm_eval/tasks/global_piqa/parallel_cloze/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,310 copying lm_eval/tasks/global_piqa/parallel_cloze/eus_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,313 copying lm_eval/tasks/global_piqa/parallel_cloze/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,315 copying lm_eval/tasks/global_piqa/parallel_cloze/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,317 copying lm_eval/tasks/global_piqa/parallel_cloze/tel_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,319 copying lm_eval/tasks/global_piqa/parallel_cloze/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,322 copying lm_eval/tasks/global_piqa/parallel_cloze/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,324 copying lm_eval/tasks/global_piqa/parallel_cloze/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,327 copying lm_eval/tasks/global_piqa/parallel_cloze/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,329 copying lm_eval/tasks/global_piqa/parallel_cloze/kan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,331 copying lm_eval/tasks/global_piqa/parallel_cloze/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,333 copying lm_eval/tasks/global_piqa/parallel_cloze/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,336 copying lm_eval/tasks/global_piqa/parallel_cloze/mag_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,338 copying lm_eval/tasks/global_piqa/parallel_cloze/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,340 copying lm_eval/tasks/global_piqa/parallel_cloze/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,343 copying lm_eval/tasks/global_piqa/parallel_cloze/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,345 copying lm_eval/tasks/global_piqa/parallel_cloze/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,347 copying lm_eval/tasks/global_piqa/parallel_cloze/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,350 copying lm_eval/tasks/global_piqa/parallel_cloze/srp_latn_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,352 copying lm_eval/tasks/global_piqa/parallel_cloze/xho_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,354 copying lm_eval/tasks/global_piqa/parallel_cloze/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,357 copying lm_eval/tasks/global_piqa/parallel_cloze/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,359 copying lm_eval/tasks/global_piqa/parallel_cloze/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,362 copying lm_eval/tasks/global_piqa/parallel_cloze/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,364 copying lm_eval/tasks/global_piqa/parallel_cloze/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,366 copying lm_eval/tasks/global_piqa/parallel_cloze/bgc_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,369 copying lm_eval/tasks/global_piqa/parallel_cloze/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,371 copying lm_eval/tasks/global_piqa/parallel_cloze/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,373 copying lm_eval/tasks/global_piqa/parallel_cloze/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,376 copying lm_eval/tasks/global_piqa/parallel_cloze/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,378 copying lm_eval/tasks/global_piqa/parallel_cloze/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,380 copying lm_eval/tasks/global_piqa/parallel_cloze/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,383 copying lm_eval/tasks/global_piqa/parallel_cloze/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,385 copying lm_eval/tasks/global_piqa/parallel_cloze/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,387 copying lm_eval/tasks/global_piqa/parallel_cloze/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,390 copying lm_eval/tasks/global_piqa/parallel_cloze/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,392 copying lm_eval/tasks/global_piqa/parallel_cloze/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,394 copying lm_eval/tasks/global_piqa/parallel_cloze/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,397 copying lm_eval/tasks/global_piqa/parallel_cloze/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,399 copying lm_eval/tasks/global_piqa/parallel_cloze/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,401 copying lm_eval/tasks/global_piqa/parallel_cloze/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,404 copying lm_eval/tasks/global_piqa/parallel_cloze/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,406 copying lm_eval/tasks/global_piqa/parallel_cloze/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,409 copying lm_eval/tasks/global_piqa/parallel_cloze/hin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,411 copying lm_eval/tasks/global_piqa/parallel_cloze/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,413 copying lm_eval/tasks/global_piqa/parallel_cloze/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,416 copying lm_eval/tasks/global_piqa/parallel_cloze/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,418 copying lm_eval/tasks/global_piqa/parallel_cloze/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,421 copying lm_eval/tasks/global_piqa/parallel_cloze/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,423 copying lm_eval/tasks/global_piqa/parallel_cloze/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,425 copying lm_eval/tasks/global_piqa/parallel_cloze/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,428 copying lm_eval/tasks/global_piqa/parallel_cloze/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,430 copying lm_eval/tasks/global_piqa/parallel_cloze/bra_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,432 copying lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,435 copying lm_eval/tasks/global_piqa/parallel_cloze/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,437 copying lm_eval/tasks/global_piqa/parallel_cloze/bcc_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,439 copying lm_eval/tasks/global_piqa/parallel_cloze/swv_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,442 copying lm_eval/tasks/global_piqa/parallel_cloze/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,444 copying lm_eval/tasks/global_piqa/parallel_cloze/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,447 copying lm_eval/tasks/global_piqa/parallel_cloze/plt_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,449 copying lm_eval/tasks/global_piqa/parallel_cloze/ceb_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,451 copying lm_eval/tasks/global_piqa/parallel_cloze/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,454 copying lm_eval/tasks/global_piqa/parallel_cloze/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,456 copying lm_eval/tasks/global_piqa/parallel_cloze/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,458 copying lm_eval/tasks/global_piqa/parallel_cloze/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,461 copying lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,463 copying lm_eval/tasks/global_piqa/parallel_cloze/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,465 copying lm_eval/tasks/global_piqa/parallel_cloze/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,468 copying lm_eval/tasks/global_piqa/parallel_cloze/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,470 copying lm_eval/tasks/global_piqa/parallel_cloze/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,472 copying lm_eval/tasks/global_piqa/parallel_cloze/ory_orya.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,475 copying lm_eval/tasks/global_piqa/parallel_cloze/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,477 copying lm_eval/tasks/global_piqa/parallel_cloze/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,479 copying lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,482 copying lm_eval/tasks/global_piqa/parallel_cloze/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,484 copying lm_eval/tasks/global_piqa/parallel_cloze/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,487 copying lm_eval/tasks/global_piqa/parallel_cloze/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,489 copying lm_eval/tasks/global_piqa/parallel_cloze/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,492 copying lm_eval/tasks/global_piqa/parallel_cloze/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,494 copying lm_eval/tasks/global_piqa/parallel_cloze/tam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,496 copying lm_eval/tasks/global_piqa/parallel_cloze/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,499 copying lm_eval/tasks/global_piqa/parallel_cloze/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,501 copying lm_eval/tasks/global_piqa/parallel_cloze/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,504 copying lm_eval/tasks/global_piqa/parallel_cloze/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,506 copying lm_eval/tasks/global_piqa/parallel_cloze/dan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,509 copying lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,511 copying lm_eval/tasks/global_piqa/parallel_cloze/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,513 copying lm_eval/tasks/global_piqa/parallel_cloze/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,516 copying lm_eval/tasks/global_piqa/parallel_cloze/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,518 copying lm_eval/tasks/global_piqa/parallel_cloze/bxr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,520 copying lm_eval/tasks/global_piqa/parallel_cloze/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,523 copying lm_eval/tasks/global_piqa/parallel_cloze/cls_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,525 copying lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,527 copying lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,530 copying lm_eval/tasks/global_piqa/parallel_cloze/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,532 copying lm_eval/tasks/global_piqa/parallel_cloze/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,534 copying lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_prle.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,537 copying lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,539 copying lm_eval/tasks/global_piqa/parallel_cloze/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,542 copying lm_eval/tasks/global_piqa/parallel_cloze/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,544 copying lm_eval/tasks/global_piqa/parallel_cloze/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,546 copying lm_eval/tasks/global_piqa/parallel_cloze/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,549 copying lm_eval/tasks/global_piqa/parallel_cloze/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,551 copying lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,554 copying lm_eval/tasks/global_piqa/parallel_cloze/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,556 copying lm_eval/tasks/global_piqa/parallel_cloze/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,559 copying lm_eval/tasks/global_piqa/parallel_cloze/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,561 copying lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,564 copying lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,566 copying lm_eval/tasks/global_piqa/parallel_cloze/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,569 copying lm_eval/tasks/global_piqa/parallel_cloze/sin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,571 copying lm_eval/tasks/global_piqa/parallel_cloze/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,573 copying lm_eval/tasks/global_piqa/parallel_cloze/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,576 copying lm_eval/tasks/global_piqa/parallel_cloze/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,579 copying lm_eval/tasks/global_piqa/parallel_cloze/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,581 copying lm_eval/tasks/global_piqa/parallel_cloze/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,583 copying lm_eval/tasks/global_piqa/parallel_cloze/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,586 copying lm_eval/tasks/global_piqa/parallel_cloze/_global_piqa_parallel_cloze.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,589 copying lm_eval/tasks/global_piqa/parallel_cloze/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,591 copying lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,594 copying lm_eval/tasks/global_piqa/parallel_cloze/ilo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:21,596 copying lm_eval/tasks/global_piqa/nonparallel_generation/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,599 copying lm_eval/tasks/global_piqa/nonparallel_generation/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,601 copying lm_eval/tasks/global_piqa/nonparallel_generation/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,603 copying lm_eval/tasks/global_piqa/nonparallel_generation/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,606 copying lm_eval/tasks/global_piqa/nonparallel_generation/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,608 copying lm_eval/tasks/global_piqa/nonparallel_generation/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,611 copying lm_eval/tasks/global_piqa/nonparallel_generation/ckb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,613 copying lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,616 copying lm_eval/tasks/global_piqa/nonparallel_generation/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,619 copying lm_eval/tasks/global_piqa/nonparallel_generation/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,622 copying lm_eval/tasks/global_piqa/nonparallel_generation/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,625 copying lm_eval/tasks/global_piqa/nonparallel_generation/mni_mtei.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,627 copying lm_eval/tasks/global_piqa/nonparallel_generation/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,629 copying lm_eval/tasks/global_piqa/nonparallel_generation/kaz_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,631 copying lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,634 copying lm_eval/tasks/global_piqa/nonparallel_generation/eus_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,636 copying lm_eval/tasks/global_piqa/nonparallel_generation/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,638 copying lm_eval/tasks/global_piqa/nonparallel_generation/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,641 copying lm_eval/tasks/global_piqa/nonparallel_generation/tel_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,643 copying lm_eval/tasks/global_piqa/nonparallel_generation/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,645 copying lm_eval/tasks/global_piqa/nonparallel_generation/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,648 copying lm_eval/tasks/global_piqa/nonparallel_generation/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,650 copying lm_eval/tasks/global_piqa/nonparallel_generation/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,652 copying lm_eval/tasks/global_piqa/nonparallel_generation/kan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,655 copying lm_eval/tasks/global_piqa/nonparallel_generation/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,657 copying lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,659 copying lm_eval/tasks/global_piqa/nonparallel_generation/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,662 copying lm_eval/tasks/global_piqa/nonparallel_generation/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,664 copying lm_eval/tasks/global_piqa/nonparallel_generation/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,666 copying lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,669 copying lm_eval/tasks/global_piqa/nonparallel_generation/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,671 copying lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,673 copying lm_eval/tasks/global_piqa/nonparallel_generation/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,676 copying lm_eval/tasks/global_piqa/nonparallel_generation/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,678 copying lm_eval/tasks/global_piqa/nonparallel_generation/bsk_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,680 copying lm_eval/tasks/global_piqa/nonparallel_generation/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,683 copying lm_eval/tasks/global_piqa/nonparallel_generation/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,685 copying lm_eval/tasks/global_piqa/nonparallel_generation/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,688 copying lm_eval/tasks/global_piqa/nonparallel_generation/bgc_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,690 copying lm_eval/tasks/global_piqa/nonparallel_generation/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,692 copying lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,695 copying lm_eval/tasks/global_piqa/nonparallel_generation/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,697 copying lm_eval/tasks/global_piqa/nonparallel_generation/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,699 copying lm_eval/tasks/global_piqa/nonparallel_generation/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,702 copying lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,704 copying lm_eval/tasks/global_piqa/nonparallel_generation/luo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,707 copying lm_eval/tasks/global_piqa/nonparallel_generation/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,709 copying lm_eval/tasks/global_piqa/nonparallel_generation/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,711 copying lm_eval/tasks/global_piqa/nonparallel_generation/asm_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,713 copying lm_eval/tasks/global_piqa/nonparallel_generation/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,716 copying lm_eval/tasks/global_piqa/nonparallel_generation/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,718 copying lm_eval/tasks/global_piqa/nonparallel_generation/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,720 copying lm_eval/tasks/global_piqa/nonparallel_generation/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,722 copying lm_eval/tasks/global_piqa/nonparallel_generation/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,724 copying lm_eval/tasks/global_piqa/nonparallel_generation/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,726 copying lm_eval/tasks/global_piqa/nonparallel_generation/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,729 copying lm_eval/tasks/global_piqa/nonparallel_generation/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,731 copying lm_eval/tasks/global_piqa/nonparallel_generation/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,733 copying lm_eval/tasks/global_piqa/nonparallel_generation/hin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,736 copying lm_eval/tasks/global_piqa/nonparallel_generation/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,738 copying lm_eval/tasks/global_piqa/nonparallel_generation/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,740 copying lm_eval/tasks/global_piqa/nonparallel_generation/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,742 copying lm_eval/tasks/global_piqa/nonparallel_generation/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,745 copying lm_eval/tasks/global_piqa/nonparallel_generation/_global_piqa_nonparallel_generation.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,748 copying lm_eval/tasks/global_piqa/nonparallel_generation/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,750 copying lm_eval/tasks/global_piqa/nonparallel_generation/sun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,753 copying lm_eval/tasks/global_piqa/nonparallel_generation/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,755 copying lm_eval/tasks/global_piqa/nonparallel_generation/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,757 copying lm_eval/tasks/global_piqa/nonparallel_generation/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,760 copying lm_eval/tasks/global_piqa/nonparallel_generation/bra_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,762 copying lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,764 copying lm_eval/tasks/global_piqa/nonparallel_generation/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,767 copying lm_eval/tasks/global_piqa/nonparallel_generation/bcc_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,769 copying lm_eval/tasks/global_piqa/nonparallel_generation/swv_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,771 copying lm_eval/tasks/global_piqa/nonparallel_generation/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,773 copying lm_eval/tasks/global_piqa/nonparallel_generation/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,776 copying lm_eval/tasks/global_piqa/nonparallel_generation/plt_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,778 copying lm_eval/tasks/global_piqa/nonparallel_generation/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,780 copying lm_eval/tasks/global_piqa/nonparallel_generation/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,782 copying lm_eval/tasks/global_piqa/nonparallel_generation/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,785 copying lm_eval/tasks/global_piqa/nonparallel_generation/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,787 copying lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,789 copying lm_eval/tasks/global_piqa/nonparallel_generation/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,791 copying lm_eval/tasks/global_piqa/nonparallel_generation/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,794 copying lm_eval/tasks/global_piqa/nonparallel_generation/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,796 copying lm_eval/tasks/global_piqa/nonparallel_generation/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,798 copying lm_eval/tasks/global_piqa/nonparallel_generation/ory_orya.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,800 copying lm_eval/tasks/global_piqa/nonparallel_generation/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,803 copying lm_eval/tasks/global_piqa/nonparallel_generation/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,805 copying lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,807 copying lm_eval/tasks/global_piqa/nonparallel_generation/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,809 copying lm_eval/tasks/global_piqa/nonparallel_generation/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,812 copying lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,814 copying lm_eval/tasks/global_piqa/nonparallel_generation/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,816 copying lm_eval/tasks/global_piqa/nonparallel_generation/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,819 copying lm_eval/tasks/global_piqa/nonparallel_generation/tam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,821 copying lm_eval/tasks/global_piqa/nonparallel_generation/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,823 copying lm_eval/tasks/global_piqa/nonparallel_generation/dje_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,826 copying lm_eval/tasks/global_piqa/nonparallel_generation/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,828 copying lm_eval/tasks/global_piqa/nonparallel_generation/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,830 copying lm_eval/tasks/global_piqa/nonparallel_generation/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,833 copying lm_eval/tasks/global_piqa/nonparallel_generation/dan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,835 copying lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,837 copying lm_eval/tasks/global_piqa/nonparallel_generation/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,840 copying lm_eval/tasks/global_piqa/nonparallel_generation/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,842 copying lm_eval/tasks/global_piqa/nonparallel_generation/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,844 copying lm_eval/tasks/global_piqa/nonparallel_generation/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,847 copying lm_eval/tasks/global_piqa/nonparallel_generation/cls_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,849 copying lm_eval/tasks/global_piqa/nonparallel_generation/btx_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,851 copying lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,854 copying lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,856 copying lm_eval/tasks/global_piqa/nonparallel_generation/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,858 copying lm_eval/tasks/global_piqa/nonparallel_generation/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,861 copying lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_prle.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,863 copying lm_eval/tasks/global_piqa/nonparallel_generation/bos_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,866 copying lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,868 copying lm_eval/tasks/global_piqa/nonparallel_generation/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,871 copying lm_eval/tasks/global_piqa/nonparallel_generation/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,873 copying lm_eval/tasks/global_piqa/nonparallel_generation/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,875 copying lm_eval/tasks/global_piqa/nonparallel_generation/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,878 copying lm_eval/tasks/global_piqa/nonparallel_generation/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,880 copying lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,883 copying lm_eval/tasks/global_piqa/nonparallel_generation/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,885 copying lm_eval/tasks/global_piqa/nonparallel_generation/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,888 copying lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,890 copying lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,892 copying lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,895 copying lm_eval/tasks/global_piqa/nonparallel_generation/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,897 copying lm_eval/tasks/global_piqa/nonparallel_generation/sin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,899 copying lm_eval/tasks/global_piqa/nonparallel_generation/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,902 copying lm_eval/tasks/global_piqa/nonparallel_generation/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,904 copying lm_eval/tasks/global_piqa/nonparallel_generation/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,907 copying lm_eval/tasks/global_piqa/nonparallel_generation/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,909 copying lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,912 copying lm_eval/tasks/global_piqa/nonparallel_generation/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,914 copying lm_eval/tasks/global_piqa/nonparallel_generation/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,916 copying lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:21,919 copying lm_eval/tasks/drop/default.yaml -> build/lib/lm_eval/tasks/drop 2026-09-01T00:39:21,921 creating build/lib/lm_eval/tasks/storycloze 2026-09-01T00:39:21,923 copying lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/lib/lm_eval/tasks/storycloze 2026-09-01T00:39:21,925 copying lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/lib/lm_eval/tasks/storycloze 2026-09-01T00:39:21,928 creating build/lib/lm_eval/tasks/nq_open 2026-09-01T00:39:21,929 copying lm_eval/tasks/nq_open/nq_open.yaml -> build/lib/lm_eval/tasks/nq_open 2026-09-01T00:39:21,932 copying lm_eval/tasks/indicparam/indicparam_oriya.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,934 copying lm_eval/tasks/indicparam/indicparam_rajasthani.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,936 copying lm_eval/tasks/indicparam/_indicparam.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,939 copying lm_eval/tasks/indicparam/indicparam_gujarati.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,941 copying lm_eval/tasks/indicparam/indicparam_sanskrit.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,944 copying lm_eval/tasks/indicparam/indicparam_dogri.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,946 copying lm_eval/tasks/indicparam/indicparam_santali.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,948 copying lm_eval/tasks/indicparam/indicparam_sanskrit_mix.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,951 copying lm_eval/tasks/indicparam/indicparam_maithili.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,953 copying lm_eval/tasks/indicparam/indicparam_konkani.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,955 copying lm_eval/tasks/indicparam/indicparam_bodo.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,957 copying lm_eval/tasks/indicparam/indicparam_nepali.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,960 copying lm_eval/tasks/indicparam/indicparam_marathi.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:21,962 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,964 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_javascript.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,967 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_biorxiv_all.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,969 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_other.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,971 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_english.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,973 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_nonenglish.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,975 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_bbc_news.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,978 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_markdown.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,980 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_nonenglish.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,982 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_cpp.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,984 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_python.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,987 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_english.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,989 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_physics.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,992 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_other.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,994 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_cs.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,996 copying lm_eval/tasks/uncheatable_eval/_uncheatable_eval_base.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:21,999 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_math.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:22,001 creating build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:39:22,002 copying lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:39:22,004 creating build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,005 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,008 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,010 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,012 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,015 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,018 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,020 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,022 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,024 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,027 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,029 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,031 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,034 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,036 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,038 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,041 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,043 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,045 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,048 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,050 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,052 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,055 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,057 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,060 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,062 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,064 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,067 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,069 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,072 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,074 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,077 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,079 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,081 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,084 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,086 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,088 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,091 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,093 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,096 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,098 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,101 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,103 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,105 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,108 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,110 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,112 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,115 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,117 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,119 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,121 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,124 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,126 copying lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,128 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,131 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,133 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,135 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,138 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,140 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:22,142 copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:39:22,144 copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:39:22,147 copying lm_eval/tasks/webqs/webqs.yaml -> build/lib/lm_eval/tasks/webqs 2026-09-01T00:39:22,149 creating build/lib/lm_eval/tasks/gsm_plus 2026-09-01T00:39:22,150 copying lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/lib/lm_eval/tasks/gsm_plus 2026-09-01T00:39:22,152 copying lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/lib/lm_eval/tasks/gsm_plus 2026-09-01T00:39:22,155 copying lm_eval/tasks/logiqa2/logieval.yaml -> build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:39:22,157 copying lm_eval/tasks/logiqa2/logiqa2.yaml -> build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:39:22,160 copying lm_eval/tasks/afrobench/afrobench.yaml -> build/lib/lm_eval/tasks/afrobench 2026-09-01T00:39:22,162 copying lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/lib/lm_eval/tasks/afrobench 2026-09-01T00:39:22,164 copying lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/lib/lm_eval/tasks/afrobench/adr 2026-09-01T00:39:22,166 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:39:22,168 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:39:22,170 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:39:22,172 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:39:22,175 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:39:22,177 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:39:22,179 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:39:22,180 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:39:22,183 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:39:22,185 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:39:22,188 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:39:22,190 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:39:22,192 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:39:22,193 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:39:22,196 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:39:22,199 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:39:22,201 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:39:22,203 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:39:22,206 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:39:22,207 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:39:22,209 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:39:22,212 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:39:22,214 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:39:22,216 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:39:22,218 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:39:22,220 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:39:22,222 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:39:22,224 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:39:22,226 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:39:22,229 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:39:22,231 copying lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:39:22,233 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:39:22,236 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:39:22,238 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:39:22,241 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:39:22,243 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:39:22,246 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:39:22,248 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:39:22,250 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:39:22,253 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:39:22,255 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:39:22,258 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:39:22,260 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:39:22,262 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:39:22,265 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:39:22,267 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:39:22,270 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:39:22,272 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:39:22,274 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:39:22,277 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:39:22,279 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:39:22,282 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:39:22,284 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:39:22,286 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:39:22,289 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:39:22,291 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:39:22,294 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:39:22,296 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:39:22,298 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:39:22,301 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:39:22,303 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:39:22,306 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:39:22,308 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:39:22,310 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:39:22,313 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:39:22,315 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:39:22,317 copying lm_eval/tasks/afrobench/salt/salt.yaml -> build/lib/lm_eval/tasks/afrobench/salt 2026-09-01T00:39:22,320 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,321 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,323 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,326 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,328 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,330 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,333 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,335 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,338 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,340 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,342 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,345 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,347 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,349 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,352 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:22,354 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,355 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,358 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,360 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,362 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,365 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,367 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,369 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,372 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,374 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,376 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,379 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,381 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,383 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,386 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:22,388 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,389 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,392 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,394 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,397 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,399 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,401 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,403 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,406 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,408 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,410 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,413 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,415 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,418 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,420 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:22,422 copying lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/lib/lm_eval/tasks/afrobench/belebele 2026-09-01T00:39:22,425 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,426 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,428 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,431 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,433 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,435 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,438 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,440 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,442 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,445 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,447 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,449 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,452 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,454 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,457 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,459 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,462 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,464 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,467 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,469 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,471 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,473 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,476 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,478 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,480 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,482 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,485 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,487 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,489 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,492 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,494 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,496 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:22,498 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,500 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,502 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,504 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,507 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,509 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,511 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,514 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,516 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,519 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,521 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,523 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,526 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,528 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,530 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,532 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,535 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,537 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,539 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,542 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,544 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,546 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,548 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,551 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,553 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,555 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,558 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,560 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,563 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,565 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,568 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,570 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:22,572 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,573 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,576 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,578 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,581 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,583 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,586 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,588 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,591 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,593 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,595 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,598 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,600 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,602 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,605 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,607 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,609 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,612 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,614 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,616 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,619 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,621 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,623 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,625 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,628 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,630 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,632 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,635 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,637 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,640 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,642 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,644 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:22,647 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,648 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,651 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,653 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,656 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,658 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,660 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,662 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,665 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,667 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,669 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,671 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,674 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,676 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,678 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,681 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,683 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,685 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,687 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,690 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,692 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,694 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,697 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,699 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,701 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,704 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,706 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,708 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,711 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,713 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,715 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,718 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:22,720 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,721 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,723 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,725 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,728 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,730 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,732 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,734 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,737 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,739 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,741 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,743 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,746 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,748 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,750 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,753 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,755 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,758 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,760 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,762 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,765 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,767 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,770 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,772 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,774 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,777 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,779 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,782 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,784 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,787 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,789 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,791 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:22,793 copying lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:39:22,796 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,798 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,800 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,803 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,805 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,807 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,810 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,812 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,815 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,817 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,819 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,821 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,824 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,826 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,828 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,831 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,833 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,835 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,838 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,840 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:22,842 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,845 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,847 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,849 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,852 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,854 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,856 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,859 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,861 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,863 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,866 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,868 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,871 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,873 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,875 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,877 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,880 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,882 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,884 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,887 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:22,889 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,892 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,894 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,897 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,899 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,901 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,904 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,906 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,909 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,911 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,913 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,916 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,918 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,920 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,923 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,925 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,927 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,930 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,932 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,934 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:22,937 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,939 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,942 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,944 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,946 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,949 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,951 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,954 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,956 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,958 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,961 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,963 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,966 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,969 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,971 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,974 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,976 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,979 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,981 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,983 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:22,986 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:22,988 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:22,990 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:22,993 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:22,995 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:22,997 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:22,999 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,002 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,004 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,007 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,009 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,011 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,014 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,016 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,019 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,021 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,023 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,026 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,028 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,030 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:23,033 copying lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:39:23,036 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,038 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,040 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,042 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,045 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,048 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,050 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,052 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,055 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,058 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,060 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,062 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,065 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,067 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,070 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,072 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,075 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:23,077 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,080 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,082 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,085 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,087 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,090 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,092 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,095 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,097 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,099 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,102 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,104 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,106 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,109 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,111 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,114 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,116 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:23,119 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,121 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,123 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,126 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,128 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,131 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,133 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,136 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,138 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,141 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,143 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,146 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,148 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,150 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,153 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,156 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,158 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:23,161 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,163 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,166 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,168 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,170 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,172 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,175 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,177 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,180 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,182 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,185 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,187 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,190 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,192 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,194 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,197 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,199 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:23,202 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,204 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,207 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,209 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,212 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,214 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,217 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,219 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,222 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,224 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,227 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,229 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,231 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,233 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,236 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,238 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,240 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:23,243 copying lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:39:23,246 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,248 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,251 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,253 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,256 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,258 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,261 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,263 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,266 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,268 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,271 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,273 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,275 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,278 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,280 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,283 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:23,285 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,288 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,290 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,292 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,295 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,297 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,299 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,302 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,304 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,306 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,308 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,311 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,313 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,316 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,318 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,321 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:23,323 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,325 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,328 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,330 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,332 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,335 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,338 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,340 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,342 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,345 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,347 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,350 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,352 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,354 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,357 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,359 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:23,362 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,364 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,366 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,369 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,371 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,373 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,375 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,378 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,380 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,383 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,386 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,388 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,391 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,393 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,395 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,398 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:23,400 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,403 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,406 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,408 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,410 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,413 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,415 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,418 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,420 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,422 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,425 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,427 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,430 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,432 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,434 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,437 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:23,439 copying lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:39:23,442 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,444 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,446 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,449 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,451 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,454 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,456 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,459 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,461 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:23,464 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,466 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,469 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,471 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,474 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,476 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,478 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,481 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,483 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:23,486 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,488 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,490 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,493 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,495 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,497 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,500 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,502 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,504 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:23,507 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,509 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,512 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,514 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,516 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,519 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,521 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,523 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,526 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:23,529 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,531 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,533 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,536 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,538 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,541 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,543 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,545 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,548 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:23,550 copying lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/lib/lm_eval/tasks/afrobench/mafand 2026-09-01T00:39:23,552 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,555 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,557 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,559 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,561 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,563 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,566 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,568 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,570 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,572 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,574 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,577 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,579 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,582 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,584 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,587 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,589 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,592 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,594 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,597 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,599 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:23,602 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,604 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,606 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,608 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,611 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,613 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,616 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,618 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,621 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,623 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,626 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,628 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,630 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,633 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,635 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,638 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,640 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,643 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,645 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,648 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,650 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:23,653 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,655 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,658 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,661 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,663 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,666 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,668 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,670 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,673 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,675 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,678 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,680 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,683 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,685 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,688 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,690 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,693 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,695 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,698 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,700 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,703 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:23,705 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,708 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,710 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,713 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,715 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,717 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,719 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,722 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,724 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,727 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,729 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,731 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,733 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,736 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,738 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,740 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,743 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,745 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,748 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,750 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,752 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:23,755 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,758 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,760 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,763 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,765 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,767 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,770 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,772 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,774 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,777 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,779 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,781 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,783 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,785 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,787 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,789 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,792 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,794 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,796 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,799 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,801 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:23,803 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,806 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,808 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,810 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,813 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,815 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,818 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,820 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,822 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,825 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,827 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,829 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,831 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,834 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,836 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,838 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,841 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,843 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,845 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,848 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,850 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:23,853 copying lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:39:23,856 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,858 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,860 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,863 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,865 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,868 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,870 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,872 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,875 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,877 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,880 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,882 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,884 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,887 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:23,889 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,891 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,894 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,896 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,898 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,901 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,903 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,906 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,909 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,911 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,913 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,916 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,918 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,920 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:23,923 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,926 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,929 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,931 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,935 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,937 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,943 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,945 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,948 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,950 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,952 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,955 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,957 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,959 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:23,962 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,965 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,967 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,970 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,973 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,977 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,980 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,982 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,984 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,987 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,989 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,992 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,994 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,997 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:23,999 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,002 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,004 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,007 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,009 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,011 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,014 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,016 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,018 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,021 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,023 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,025 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,028 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,030 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:24,033 copying lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:39:24,035 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,037 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,039 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,042 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,044 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,047 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,049 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,051 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,054 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,056 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,059 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,061 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,064 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,066 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,069 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,071 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,073 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,076 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,078 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,081 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,083 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,085 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,087 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,089 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,092 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,094 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,096 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,099 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,101 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,104 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,106 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,108 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,111 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:24,113 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,114 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,117 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,120 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,122 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,125 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,127 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,130 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,132 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,134 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,137 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,139 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,142 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,144 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,146 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,149 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,151 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,154 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,156 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,159 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,161 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,163 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,166 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,168 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,171 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,173 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,176 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,178 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,181 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,183 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,185 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,188 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,190 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:24,192 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,193 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,196 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,198 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,200 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,203 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,205 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,207 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,210 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,212 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,214 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,219 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,221 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,224 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,226 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,229 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,231 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,234 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,237 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,239 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,241 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,244 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,246 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,248 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,251 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,253 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,255 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,257 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,260 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,262 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,265 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,267 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,269 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:24,272 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,273 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,275 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,278 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,280 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,283 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,285 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,287 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,290 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,292 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,294 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,297 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,299 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,301 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,304 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,306 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,308 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,311 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,313 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,316 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,318 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,321 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,323 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,325 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,328 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,330 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,333 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,335 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,337 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,340 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,342 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,344 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,347 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:24,349 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,351 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,353 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,356 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,358 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,360 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,363 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,365 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,368 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,370 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,372 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,375 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,377 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,380 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,382 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,385 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,387 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,390 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,392 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,395 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,397 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,400 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,402 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,404 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,406 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,408 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,411 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,413 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,415 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,418 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,420 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,422 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,424 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:24,427 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,428 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,430 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,433 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,435 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,438 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,440 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,443 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,445 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,448 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,450 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,453 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,455 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,458 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,460 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,462 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,465 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,467 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,470 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,472 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,475 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,477 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,480 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,482 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,485 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,487 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,489 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,492 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,494 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,497 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,500 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,502 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,505 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:24,509 copying lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:39:24,511 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:39:24,514 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:39:24,516 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:39:24,518 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:39:24,521 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:39:24,523 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:39:24,525 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:39:24,528 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:39:24,530 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:39:24,533 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:39:24,535 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:39:24,538 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:39:24,540 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:39:24,543 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:39:24,545 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:39:24,547 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:39:24,550 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:39:24,552 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:39:24,555 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:39:24,557 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:39:24,560 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:39:24,562 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:39:24,565 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:39:24,567 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:39:24,569 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:39:24,571 copying lm_eval/tasks/afrobench/flores/flores.yaml -> build/lib/lm_eval/tasks/afrobench/flores 2026-09-01T00:39:24,573 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,575 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,577 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,580 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,582 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,584 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,587 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,589 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,591 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,594 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,596 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,599 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,601 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,603 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,606 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,608 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,611 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,613 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,616 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,618 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,620 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,623 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,625 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,627 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,630 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,632 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,634 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,637 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,639 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,641 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,644 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,646 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,648 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,651 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,653 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,656 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,658 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,660 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,663 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,665 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,667 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,670 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,672 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,674 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,677 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,679 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,681 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,684 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,686 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,688 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,691 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,693 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,695 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,698 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,700 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,703 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,705 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,708 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,710 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,713 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,715 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,718 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,720 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:24,723 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,724 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,726 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,729 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,731 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,733 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,735 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,738 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,740 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,743 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,745 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,748 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,750 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,752 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,754 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,757 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,759 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,762 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,764 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,767 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,769 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,771 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,774 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,776 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,778 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,781 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,783 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,785 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,788 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,790 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,792 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,795 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,797 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,799 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,802 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,804 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,806 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,809 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,811 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,814 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,816 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,818 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,821 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,823 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,826 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,828 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,831 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,833 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,835 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,838 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,840 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,842 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,845 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,847 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,849 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,852 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,854 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,856 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,859 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,861 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,863 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,866 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,868 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:24,870 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,872 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,874 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,877 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,879 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,881 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,883 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,886 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,888 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,890 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,893 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,895 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,897 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,900 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,902 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,905 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,907 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,910 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,912 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,915 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,917 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,919 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,922 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,924 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,926 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,929 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,931 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,933 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,936 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,938 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,940 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,942 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,944 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,946 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,949 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,951 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,953 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,956 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,958 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,960 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,963 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,965 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,967 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,970 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,972 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,974 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,977 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,979 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,981 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,983 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,986 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,988 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,990 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,992 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,995 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,997 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:24,999 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:25,002 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:25,004 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:25,006 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:25,008 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:25,011 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:25,013 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:25,015 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,016 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,019 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,021 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,024 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,026 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,028 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,030 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,033 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,035 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,037 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,039 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,042 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,044 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,046 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,049 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,051 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,053 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,056 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,058 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,060 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,063 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,065 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,068 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,070 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,072 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,075 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,077 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,079 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,082 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,084 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,086 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,088 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,091 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,093 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,096 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,098 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,100 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,103 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,105 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,108 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,110 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,112 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,115 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,118 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,120 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,122 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,125 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,128 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,130 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,132 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,134 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,137 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,139 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,141 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,144 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,146 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,148 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,151 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,153 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,155 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,158 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,160 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:25,162 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,164 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,166 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,169 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,171 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,174 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,176 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,178 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,181 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,183 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,185 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,187 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,190 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,192 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,194 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,196 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,199 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,201 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,203 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,206 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,208 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,211 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,213 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,215 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,218 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,220 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,222 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,225 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,227 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,230 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,232 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,234 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,236 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,238 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,240 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,243 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,245 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,247 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,250 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,252 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,254 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,257 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,259 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,261 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,263 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,266 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,268 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,271 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,273 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,275 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,278 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,280 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,282 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,285 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,287 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,289 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,292 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,294 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,296 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,298 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,301 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,303 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,305 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:25,307 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,308 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,311 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,313 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,316 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,318 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,320 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,323 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,325 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,328 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,330 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,333 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,335 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,337 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,339 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,342 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,344 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,346 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,348 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,351 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,353 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,356 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,358 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,360 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,363 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,365 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,368 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,370 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,372 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,375 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,377 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,379 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,382 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,384 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,386 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,389 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,391 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,393 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,395 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,398 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,400 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,402 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,405 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,407 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,409 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,412 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,414 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,417 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,419 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,421 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,424 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,426 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,429 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,431 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,434 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,436 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,438 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,440 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,443 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,445 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,447 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,450 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,452 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:25,455 copying lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:39:25,457 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:39:25,458 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:39:25,461 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:39:25,463 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:39:25,465 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:39:25,467 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:39:25,469 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:39:25,472 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:39:25,474 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:39:25,475 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:39:25,478 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:39:25,480 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:39:25,482 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:39:25,484 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:39:25,486 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:39:25,489 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:39:25,491 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:39:25,492 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:39:25,495 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:39:25,497 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:39:25,499 copying lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:39:25,502 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,504 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,507 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,509 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,511 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,514 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,516 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,519 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,521 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,524 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,526 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,529 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,531 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,533 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,536 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,538 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,541 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,543 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,546 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,548 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:25,551 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,553 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,556 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,558 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,560 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,563 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,565 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,568 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,571 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,574 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,577 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,580 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,582 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,585 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,588 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,591 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,594 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,597 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,600 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,603 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:25,606 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,609 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,612 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,615 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,618 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,621 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,624 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,627 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,630 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,633 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,636 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,639 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,642 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,645 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,647 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,650 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,653 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,656 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,659 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,662 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:25,665 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,667 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,669 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,672 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,674 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,677 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,679 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,682 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,684 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,687 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,689 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,692 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,694 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,696 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,699 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,701 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,704 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,706 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,709 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,711 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:25,713 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,716 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,719 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,721 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,723 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,726 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,728 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,731 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,733 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,736 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,738 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,740 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,743 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,745 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,748 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,750 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,753 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,755 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,757 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,760 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:25,762 copying lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:39:25,765 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:39:25,766 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:39:25,768 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:39:25,771 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:39:25,773 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:39:25,774 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:39:25,776 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:39:25,779 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:39:25,781 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:39:25,782 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:39:25,784 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:39:25,787 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:39:25,789 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:39:25,790 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:39:25,792 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:39:25,795 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:39:25,797 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:39:25,798 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:39:25,801 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:39:25,803 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:39:25,806 copying lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:39:25,808 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,811 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,813 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,815 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,818 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,820 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,822 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,825 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,828 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,830 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,832 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,834 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:25,837 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,839 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,841 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,843 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,846 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,848 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,850 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,852 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,855 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,857 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,859 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,861 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:25,864 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,866 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,868 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,870 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,873 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,875 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,877 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,880 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,882 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,885 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,887 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,890 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:25,892 copying lm_eval/tasks/afrobench/sib/sib.yaml -> build/lib/lm_eval/tasks/afrobench/sib 2026-09-01T00:39:25,895 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,897 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,899 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,901 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,904 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,906 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,908 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,911 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,913 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,915 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,918 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,920 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,922 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,924 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,927 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,929 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,932 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,934 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,937 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,939 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,941 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,944 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,946 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,948 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,951 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,953 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,955 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,958 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,960 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,963 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,965 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,968 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,970 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,973 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,975 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,977 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,980 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,982 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,984 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,987 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,989 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,991 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,994 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,996 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:25,999 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,001 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,003 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,006 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,009 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,011 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,014 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,016 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,019 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,021 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,023 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,026 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:26,028 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,031 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,033 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,036 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,038 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,041 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,043 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,045 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,048 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,050 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,052 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,054 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,057 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,059 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,061 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,064 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,066 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,068 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,071 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,073 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,076 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,078 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,080 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,083 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,085 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,087 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,090 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,092 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,094 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,097 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,099 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,101 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,104 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,106 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,109 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,111 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,113 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,116 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,118 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,120 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,123 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,125 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,127 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,130 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,132 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,134 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,137 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,139 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,141 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,143 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,146 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,148 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,151 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,153 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,156 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,158 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:26,160 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,163 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,165 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,168 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,170 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,173 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,175 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,178 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,180 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,183 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,185 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,188 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,190 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,193 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,195 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,197 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,200 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,202 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,205 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,207 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,210 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,212 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,215 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,217 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,220 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,222 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,224 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,227 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,230 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,232 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,234 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,237 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,239 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,242 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,244 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,247 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,249 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,252 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,254 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,256 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,259 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,261 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,264 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,266 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,268 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,271 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,273 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,275 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,278 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,280 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,282 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,285 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,287 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,289 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,292 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,294 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:26,297 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,299 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,302 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,304 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,306 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,309 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,311 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,314 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,316 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,319 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,321 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,324 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,326 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,329 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,331 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,334 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,337 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,339 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,341 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,344 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,346 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,348 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,351 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,353 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,355 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,358 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,360 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,362 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,365 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,367 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,370 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,373 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,376 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,379 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,382 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,385 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,388 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,391 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,394 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,397 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,400 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,403 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,406 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,409 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,412 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,416 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,419 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,422 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,424 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,427 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,430 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,433 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,436 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,439 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,442 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,445 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:26,448 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,451 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,454 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,457 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,460 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,463 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,465 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,469 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,471 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,473 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,476 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,478 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,481 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,483 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,485 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,488 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,490 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,493 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,495 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,497 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,500 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,502 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,504 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,507 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,509 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,512 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,514 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,517 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,519 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,522 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,525 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,527 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,529 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,532 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,534 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,537 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,540 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,542 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,544 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,547 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,549 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,552 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,554 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,557 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,559 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,561 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,564 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,566 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,569 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,571 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,574 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,576 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,579 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,581 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,583 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,586 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:26,588 copying lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,591 copying lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,593 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,596 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,598 copying lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,600 copying lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,602 copying lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,605 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,607 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,610 copying lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,612 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,614 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,617 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,619 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,622 copying lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,624 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,626 copying lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,629 copying lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,631 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,633 copying lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,636 copying lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,638 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,641 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,643 copying lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,646 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,648 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,650 copying lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,653 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,655 copying lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,658 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,660 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,662 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,665 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,667 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,669 copying lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,672 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,674 copying lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,677 copying lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,679 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,682 copying lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,684 copying lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,687 copying lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,689 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,692 copying lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,694 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,697 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,700 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,702 copying lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,705 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,708 copying lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,710 copying lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,713 copying lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,716 copying lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,719 copying lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,721 copying lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,724 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,726 copying lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,729 copying lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:26,731 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,734 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,736 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,739 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,741 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,743 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,746 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,749 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,752 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,754 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,757 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,759 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,762 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,764 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,767 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,770 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,772 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,774 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,777 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,780 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,782 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,784 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,787 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,789 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,791 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,794 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,796 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,799 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,801 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,803 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,806 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,808 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,811 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,813 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,816 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,819 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,821 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,824 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,826 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,829 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,831 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,834 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,836 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,839 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,841 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,844 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,846 copying lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,849 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,851 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,853 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,856 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,858 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,861 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,863 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,865 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,868 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,870 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,873 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:26,875 copying lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,877 copying lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,881 copying lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,883 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,886 copying lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,889 copying lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,891 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,894 copying lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,897 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,899 copying lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,902 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,905 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,907 copying lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,910 copying lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,912 copying lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,914 copying lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,917 copying lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,920 copying lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,922 copying lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,924 copying lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,927 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,930 copying lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,932 copying lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,935 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,937 copying lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,940 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,942 copying lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,945 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,947 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,950 copying lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,952 copying lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,955 copying lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,957 copying lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,959 copying lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,961 copying lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,963 copying lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,966 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,968 copying lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,971 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,973 copying lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,975 copying lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,977 copying lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,979 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,981 copying lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,983 copying lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,986 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,988 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,990 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,992 copying lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,994 copying lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,997 copying lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:26,999 copying lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:27,001 copying lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:27,003 copying lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:27,005 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:27,008 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:27,010 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:27,012 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:27,015 copying lm_eval/tasks/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:39:27,017 copying lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:39:27,020 copying lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:39:27,022 copying lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:39:27,024 copying lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:39:27,027 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:39:27,029 copying lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:39:27,031 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:39:27,034 copying lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:39:27,036 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:39:27,038 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:39:27,040 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:39:27,042 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:39:27,044 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:39:27,046 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:39:27,048 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,050 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,052 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,054 copying lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,056 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,059 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,061 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,063 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,066 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,068 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,070 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,072 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,075 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,077 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,079 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,082 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,084 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,086 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,088 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,091 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,093 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,095 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,097 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,099 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,101 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:27,104 copying lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:39:27,106 copying lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:39:27,108 copying lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:39:27,110 copying lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:39:27,112 copying lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:39:27,115 copying lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,117 copying lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,119 copying lm_eval/tasks/unitxt/xsum.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,121 copying lm_eval/tasks/unitxt/atis.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,123 copying lm_eval/tasks/unitxt/argument_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,126 copying lm_eval/tasks/unitxt/stsb.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,128 copying lm_eval/tasks/unitxt/unfair_tos.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,130 copying lm_eval/tasks/unitxt/ledgar.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,132 copying lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,134 copying lm_eval/tasks/unitxt/ag_news.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,136 copying lm_eval/tasks/unitxt/doc_vqa.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,139 copying lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,141 copying lm_eval/tasks/unitxt/financial_tweets.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,143 copying lm_eval/tasks/unitxt/coedit_gec.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,145 copying lm_eval/tasks/unitxt/banking77.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,147 copying lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,149 copying lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,151 copying lm_eval/tasks/unitxt/ethos_binary.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,153 copying lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:27,155 creating build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,157 copying lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,159 copying lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,161 copying lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,163 copying lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,165 copying lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,167 copying lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,169 copying lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,171 copying lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,174 copying lm_eval/tasks/turkishmmlu/config/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:27,176 creating build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,177 copying lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,179 copying lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,182 copying lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,185 copying lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,187 copying lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,190 copying lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,193 copying lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,195 copying lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,198 copying lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:27,201 copying lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:39:27,203 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,206 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,208 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,210 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,212 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,215 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,218 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,220 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,222 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,224 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,226 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,228 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,231 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,233 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,236 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,238 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,240 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,242 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,245 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,247 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,249 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,252 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,254 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,256 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,258 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,261 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,263 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,266 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,268 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,270 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,272 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,275 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,277 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,279 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,281 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,284 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,286 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,288 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,291 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,293 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,296 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,298 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,300 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,303 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,305 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,307 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,309 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,312 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,314 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,316 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,318 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,321 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,323 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,326 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,328 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,330 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,332 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,334 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,337 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,339 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,341 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,344 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:27,346 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,349 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,351 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,354 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,356 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,359 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,361 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,364 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,367 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,369 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,372 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,374 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,376 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,379 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,382 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,385 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,388 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,390 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,393 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,396 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,399 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,402 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,405 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,407 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,410 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,412 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,415 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,418 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,421 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,423 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,426 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,429 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,432 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,434 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,438 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,440 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,442 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,445 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,448 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,450 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,453 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,456 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,459 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,462 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,464 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,467 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,470 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,473 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,475 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,478 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,481 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,483 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,486 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,488 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,491 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,493 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,495 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,498 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,501 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,503 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,505 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,508 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:27,511 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,513 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,516 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,518 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,520 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,523 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,525 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,527 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,530 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,532 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,534 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,537 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,539 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,541 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,544 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,546 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,548 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,551 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,553 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,556 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,558 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,560 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,562 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,564 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,566 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,569 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,571 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,573 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,576 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,578 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,580 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,583 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,585 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,588 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,590 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,592 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,595 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,597 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,599 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,601 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,603 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,606 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,608 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,610 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,613 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,616 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,618 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,620 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,623 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,625 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,627 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,629 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,632 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,634 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,636 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,639 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,642 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,644 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,647 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,649 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,652 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,654 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:27,657 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,659 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,662 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,665 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,669 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,671 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,674 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,676 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,679 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,682 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,685 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,687 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,690 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,692 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,695 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,697 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,700 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,703 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,706 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,708 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,711 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,714 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,717 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,719 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,722 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,725 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,727 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,730 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,733 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,736 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,739 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,742 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,745 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,748 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,751 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,754 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,757 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,759 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,762 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,765 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,768 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,771 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,774 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,777 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,779 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,782 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,785 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,787 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,789 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,792 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,795 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,797 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,800 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,803 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,806 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,809 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,811 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,814 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,817 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,820 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,823 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,826 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:27,829 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,831 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,833 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,836 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,838 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,840 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,843 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,845 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,848 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,851 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,854 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,856 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,859 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,861 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,863 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,866 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,868 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,871 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,873 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,875 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,878 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,880 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,882 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,885 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,887 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,890 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,892 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,894 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,897 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,899 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,902 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,904 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,907 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,909 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,911 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,913 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,916 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,918 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,920 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,922 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,925 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,928 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,930 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,933 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,935 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,938 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,940 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,942 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,945 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,948 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,951 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,953 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,955 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,957 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,960 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,962 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,964 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,967 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,969 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,971 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,974 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,976 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:27,978 creating build/lib/lm_eval/tasks/llama3/instruct/gsm8k 2026-09-01T00:39:27,979 copying lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/llama3/instruct/gsm8k 2026-09-01T00:39:27,982 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:27,984 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:27,987 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:27,989 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:27,991 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:27,993 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:27,996 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:27,998 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,001 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,003 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,006 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,008 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,011 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,013 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,016 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,019 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,021 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,023 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,025 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,028 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,030 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,032 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,035 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,037 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,039 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,042 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,044 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,047 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,049 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,052 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,056 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,058 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,061 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,063 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,066 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,068 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,071 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,073 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,076 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,078 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,081 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,083 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,086 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,088 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,090 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,093 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,095 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,097 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,100 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,102 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,105 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,108 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,110 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,112 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,115 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,117 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,119 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,122 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,124 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,127 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,129 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,132 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:28,134 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,135 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,138 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,140 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,143 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,145 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,147 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,150 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,152 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,154 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,156 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,158 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,161 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,163 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,165 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,168 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,170 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,172 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,175 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,177 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,179 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,181 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,184 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,186 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,189 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,191 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,193 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,196 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,198 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,200 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,203 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,205 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,207 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,210 copying lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,212 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,214 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,217 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,219 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,221 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,223 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,225 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,228 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,230 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,232 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,235 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,237 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,240 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,242 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,244 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,247 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,249 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,251 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,254 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,256 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,259 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,261 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,263 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,266 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,268 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,270 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,273 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,275 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,277 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:28,280 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,281 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,283 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,285 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,287 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,290 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,292 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,294 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,297 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,299 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,301 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,303 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,306 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,308 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,310 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,312 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,315 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,317 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,320 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,322 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,324 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,327 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,329 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,331 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,334 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,336 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,339 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,341 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,343 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,346 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,348 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,350 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,352 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,354 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,357 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,359 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,361 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,364 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,366 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,368 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,370 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,373 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,375 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,378 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,380 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,382 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,384 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,387 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,389 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,392 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,394 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,396 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,399 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,401 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,403 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,406 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,408 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,410 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,413 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,415 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,417 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,419 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,422 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:28,424 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,426 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,429 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,431 copying lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,433 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,436 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,438 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,440 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,442 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,445 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,448 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,450 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,452 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,455 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,457 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:28,459 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,462 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,464 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,467 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,469 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,471 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,473 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,476 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,478 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,481 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,483 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,486 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,488 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,491 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,493 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,496 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,498 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,501 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,503 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,506 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,508 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,511 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,513 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,516 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,518 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,521 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,524 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,526 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,529 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,532 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,534 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,537 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,539 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,541 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,544 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,547 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,549 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,551 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,554 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,556 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,559 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,561 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,564 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,566 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,569 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,571 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,573 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,576 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,579 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,581 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,583 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,586 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,588 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,591 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,593 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,596 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,598 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,601 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,603 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,606 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,608 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,610 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:28,613 copying lm_eval/tasks/mutual/multual_plus.yaml -> build/lib/lm_eval/tasks/mutual 2026-09-01T00:39:28,615 copying lm_eval/tasks/mutual/mutual.yaml -> build/lib/lm_eval/tasks/mutual 2026-09-01T00:39:28,618 copying lm_eval/tasks/aradice/aradice.yaml -> build/lib/lm_eval/tasks/aradice 2026-09-01T00:39:28,620 copying lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:39:28,623 copying lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:39:28,625 copying lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:39:28,627 copying lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:39:28,630 copying lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:39:28,632 copying lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:39:28,634 copying lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:39:28,637 copying lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:39:28,639 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:39:28,641 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:39:28,644 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:39:28,646 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:39:28,648 copying lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:39:28,651 copying lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:39:28,653 copying lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:39:28,655 copying lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:39:28,658 copying lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:39:28,660 copying lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:39:28,662 copying lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:39:28,665 copying lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:39:28,667 copying lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:39:28,669 copying lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:39:28,672 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,674 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,677 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,679 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,681 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,683 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,686 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,688 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,690 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,692 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,695 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,697 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,699 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,702 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,704 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,706 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,709 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,711 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,713 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,716 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,718 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,720 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,722 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,725 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,727 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,729 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,732 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,734 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,737 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,739 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,741 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,743 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,746 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,748 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,750 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,753 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,755 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,757 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,760 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,762 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,765 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:28,767 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,770 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,772 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,775 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,777 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,779 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,782 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,784 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,787 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,789 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,791 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,794 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,796 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,798 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,801 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,803 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,806 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,808 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,810 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,813 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,815 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,817 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,820 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,822 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,824 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,827 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,829 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,831 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,834 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,836 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,839 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,841 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,844 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,846 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,848 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,850 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,853 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,855 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,857 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,860 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,862 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:28,865 copying lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:39:28,867 copying lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:39:28,869 copying lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:39:28,872 copying lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:39:28,874 creating build/lib/lm_eval/tasks/eus_proficiency 2026-09-01T00:39:28,875 copying lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/lib/lm_eval/tasks/eus_proficiency 2026-09-01T00:39:28,878 copying lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:39:28,880 copying lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:39:28,883 copying lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:39:28,885 copying lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:39:28,887 copying lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:39:28,890 copying lm_eval/tasks/bbq/bbq_generate.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:39:28,893 copying lm_eval/tasks/tydiqa/tydiqa_goldp_bn.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,895 copying lm_eval/tasks/tydiqa/tydiqa_goldp_ru.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,897 copying lm_eval/tasks/tydiqa/tydiqa_goldp_fi.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,900 copying lm_eval/tasks/tydiqa/tydiqa_goldp_en.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,902 copying lm_eval/tasks/tydiqa/tydiqa_goldp_sw.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,905 copying lm_eval/tasks/tydiqa/tydiqa_goldp_ar.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,907 copying lm_eval/tasks/tydiqa/tydiqa_goldp_te.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,909 copying lm_eval/tasks/tydiqa/tydiqa_goldp_id.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,912 copying lm_eval/tasks/tydiqa/tydiqa_goldp_ko.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:28,914 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,915 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,918 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,920 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,923 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,925 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,928 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,930 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,932 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,935 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,937 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,940 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,942 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,944 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,947 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,949 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,952 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,954 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,957 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,959 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,962 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,964 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,967 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,969 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,972 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,974 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,977 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,979 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,982 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,984 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,986 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,989 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,991 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,994 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,996 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:28,999 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,001 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,004 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,006 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,009 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,012 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,015 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,017 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,020 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,022 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,024 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,027 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,029 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,032 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,034 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,037 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,039 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,041 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,043 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,046 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,048 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,050 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,053 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,055 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:29,058 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,060 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,062 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,065 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,067 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,069 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,072 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,074 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,076 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,079 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,081 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,084 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,086 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,089 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,091 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,094 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,096 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,099 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,101 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,103 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,106 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,108 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,110 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,113 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,115 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,117 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,119 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,122 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,124 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,126 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,129 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,131 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,134 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,136 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,138 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,141 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,143 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,145 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,148 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,150 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,152 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,155 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,157 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,159 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,162 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,164 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,167 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,169 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,171 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,174 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,176 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,179 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,181 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,183 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,186 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,188 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,191 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,194 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:29,197 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,199 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,202 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,204 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,207 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,209 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,212 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,215 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,217 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,220 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,223 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,226 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,228 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,230 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,232 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,235 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,238 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,240 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,242 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,245 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,247 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,250 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,252 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,254 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,257 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,259 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,262 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,264 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,266 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,269 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,271 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,274 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,276 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,279 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,281 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,283 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,286 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,288 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,291 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,294 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,296 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,299 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,301 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,303 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,306 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,308 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,311 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,313 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,315 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,318 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,320 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,323 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,325 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,328 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,330 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,332 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,335 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,337 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:29,339 creating build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,340 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,343 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,345 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,348 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,351 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,353 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,356 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,359 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,361 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,363 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,366 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,368 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,371 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,373 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,376 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,379 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,381 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,385 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,388 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,391 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,394 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,397 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,399 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,402 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,404 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,407 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,410 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,413 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,416 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,418 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,421 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,424 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,427 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,429 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,432 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,436 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,440 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,444 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,449 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,455 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,460 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,464 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,468 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,470 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,473 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,476 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,479 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,482 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,485 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,488 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,490 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,492 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,495 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,498 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,500 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,503 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,506 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,512 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:29,517 creating build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,519 copying lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,522 copying lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,525 copying lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,527 copying lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,530 copying lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,533 copying lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,535 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,537 copying lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,540 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,542 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,544 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,547 copying lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,549 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,552 copying lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,554 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,557 copying lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,559 copying lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,562 copying lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,564 copying lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,566 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,569 copying lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,571 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,573 copying lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,576 copying lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,579 copying lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,581 copying lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,583 copying lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,586 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,588 copying lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,590 copying lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,593 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,595 copying lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,597 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,599 copying lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,602 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,604 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,606 copying lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,609 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,611 copying lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,613 copying lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,615 copying lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,617 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,620 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,622 copying lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,624 copying lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,626 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,628 copying lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,631 copying lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,633 copying lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,635 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,637 copying lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,640 copying lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,642 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,644 copying lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,646 copying lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,648 copying lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,651 copying lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,653 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:29,655 creating build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,657 copying lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,659 copying lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,661 copying lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,664 copying lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,666 copying lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,668 copying lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,671 copying lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,673 copying lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,675 copying lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,678 copying lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,680 copying lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,682 copying lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,684 copying lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,686 copying lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,688 copying lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,690 copying lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,692 copying lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,695 copying lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,697 copying lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,699 copying lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,701 copying lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,704 copying lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,706 copying lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,708 copying lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,710 copying lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,713 copying lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,715 copying lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,717 copying lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,720 copying lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,722 copying lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,724 copying lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,726 copying lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,729 copying lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,731 copying lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,733 copying lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,736 copying lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,738 copying lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,740 copying lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,743 copying lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,745 copying lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,748 copying lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,750 copying lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,752 copying lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,754 copying lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,756 copying lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,758 copying lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,760 copying lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,763 copying lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,765 copying lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,767 copying lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,770 copying lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,772 copying lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,774 copying lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,776 copying lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,779 copying lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,781 copying lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,783 copying lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,786 copying lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,788 copying lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,790 copying lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,792 copying lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,795 copying lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:29,797 creating build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,798 copying lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,800 copying lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,803 copying lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,805 copying lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,807 copying lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,810 copying lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,812 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,814 copying lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,817 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,819 copying lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,821 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,823 copying lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,826 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,828 copying lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,830 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,832 copying lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,835 copying lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,837 copying lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,839 copying lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,841 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,844 copying lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,846 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,848 copying lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,850 copying lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,853 copying lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,855 copying lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,857 copying lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,860 copying lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,862 copying lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,864 copying lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,867 copying lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,869 copying lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,872 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,874 copying lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,876 copying lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,878 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,881 copying lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,883 copying lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,885 copying lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,887 copying lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,890 copying lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,892 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,894 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,897 copying lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,900 copying lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,903 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,905 copying lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,907 copying lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,909 copying lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,912 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,914 copying lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,916 copying lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,919 copying lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,921 copying lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,923 copying lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,925 copying lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,928 copying lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,930 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:29,933 copying lm_eval/tasks/wikitext/wikitext.yaml -> build/lib/lm_eval/tasks/wikitext 2026-09-01T00:39:29,935 creating build/lib/lm_eval/tasks/pile_10k 2026-09-01T00:39:29,937 copying lm_eval/tasks/pile_10k/pile_10k.yaml -> build/lib/lm_eval/tasks/pile_10k 2026-09-01T00:39:29,940 copying lm_eval/tasks/medqa/medqa.yaml -> build/lib/lm_eval/tasks/medqa 2026-09-01T00:39:29,942 copying lm_eval/tasks/medtext/medtext.yaml -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:39:29,945 copying lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:39:29,947 copying lm_eval/tasks/noticia/noticia.yaml -> build/lib/lm_eval/tasks/noticia 2026-09-01T00:39:29,950 copying lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:39:29,952 copying lm_eval/tasks/olaph/olaph.yaml -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:39:29,955 copying lm_eval/tasks/race/race.yaml -> build/lib/lm_eval/tasks/race 2026-09-01T00:39:29,957 copying lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,959 copying lm_eval/tasks/metabench/metabench_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,962 copying lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,964 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,966 copying lm_eval/tasks/metabench/metabench.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,968 copying lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,971 copying lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,973 copying lm_eval/tasks/metabench/metabench_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,975 copying lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,978 copying lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,980 copying lm_eval/tasks/metabench/metabench_arc.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,982 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,985 copying lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,987 copying lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,989 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,992 copying lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,994 copying lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:29,997 copying lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,000 copying lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,002 copying lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,005 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,008 copying lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,011 copying lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,014 copying lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,017 copying lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,020 copying lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:30,024 copying lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:30,026 copying lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:30,029 copying lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:30,032 copying lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:30,035 copying lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:30,038 copying lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:30,041 copying lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:30,044 creating build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:39:30,046 copying lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:39:30,049 copying lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:39:30,052 copying lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:39:30,055 copying lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:39:30,057 copying lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:39:30,060 creating build/lib/lm_eval/tasks/anli 2026-09-01T00:39:30,061 copying lm_eval/tasks/anli/anli_r1.yaml -> build/lib/lm_eval/tasks/anli 2026-09-01T00:39:30,064 copying lm_eval/tasks/anli/anli_r2.yaml -> build/lib/lm_eval/tasks/anli 2026-09-01T00:39:30,067 copying lm_eval/tasks/anli/anli_r3.yaml -> build/lib/lm_eval/tasks/anli 2026-09-01T00:39:30,070 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,073 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,076 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,079 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,082 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,085 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,088 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,090 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,093 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,096 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,099 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,101 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,104 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,106 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,108 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,111 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,113 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,115 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:30,118 copying lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,120 copying lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,123 copying lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,125 copying lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,127 copying lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,130 copying lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,132 copying lm_eval/tasks/paloma/paloma_mc4.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,134 copying lm_eval/tasks/paloma/paloma_ptb.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,137 copying lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,139 copying lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,141 copying lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,143 copying lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,146 copying lm_eval/tasks/paloma/paloma_gab.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,148 copying lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,151 copying lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,153 copying lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:30,155 copying lm_eval/tasks/graphwalks/graphwalks_128k.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:39:30,158 copying lm_eval/tasks/graphwalks/graphwalks_1M.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:39:30,160 copying lm_eval/tasks/graphwalks/graphwalks.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:39:30,162 creating build/lib/lm_eval/tasks/prost 2026-09-01T00:39:30,164 copying lm_eval/tasks/prost/corypaik_prost.yaml -> build/lib/lm_eval/tasks/prost 2026-09-01T00:39:30,166 copying lm_eval/tasks/moral_stories/moral_stories.yaml -> build/lib/lm_eval/tasks/moral_stories 2026-09-01T00:39:30,169 creating build/lib/lm_eval/tasks/sciq 2026-09-01T00:39:30,170 copying lm_eval/tasks/sciq/sciq.yaml -> build/lib/lm_eval/tasks/sciq 2026-09-01T00:39:30,172 creating build/lib/lm_eval/tasks/swag 2026-09-01T00:39:30,173 copying lm_eval/tasks/swag/swag.yaml -> build/lib/lm_eval/tasks/swag 2026-09-01T00:39:30,176 copying lm_eval/tasks/putnam_axiom/putnam_axiom_variations_org.yaml -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:39:30,179 copying lm_eval/tasks/putnam_axiom/putnam_axiom_original.yaml -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:39:30,181 copying lm_eval/tasks/putnam_axiom/putnam_axiom_variations.yaml -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:39:30,183 copying lm_eval/tasks/putnam_axiom/putnam_axiom.yaml -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:39:30,185 creating build/lib/lm_eval/tasks/arc 2026-09-01T00:39:30,187 copying lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/lib/lm_eval/tasks/arc 2026-09-01T00:39:30,189 copying lm_eval/tasks/arc/arc_easy.yaml -> build/lib/lm_eval/tasks/arc 2026-09-01T00:39:30,191 copying lm_eval/tasks/arc/arc_challenge.yaml -> build/lib/lm_eval/tasks/arc 2026-09-01T00:39:30,194 copying lm_eval/tasks/common_voice/common_voice_en.yaml -> build/lib/lm_eval/tasks/common_voice 2026-09-01T00:39:30,196 creating build/lib/lm_eval/tasks/glue/qqp 2026-09-01T00:39:30,198 copying lm_eval/tasks/glue/qqp/default.yaml -> build/lib/lm_eval/tasks/glue/qqp 2026-09-01T00:39:30,201 copying lm_eval/tasks/glue/mnli/mismatch.yaml -> build/lib/lm_eval/tasks/glue/mnli 2026-09-01T00:39:30,203 copying lm_eval/tasks/glue/mnli/default.yaml -> build/lib/lm_eval/tasks/glue/mnli 2026-09-01T00:39:30,205 creating build/lib/lm_eval/tasks/glue/wnli 2026-09-01T00:39:30,207 copying lm_eval/tasks/glue/wnli/default.yaml -> build/lib/lm_eval/tasks/glue/wnli 2026-09-01T00:39:30,209 creating build/lib/lm_eval/tasks/glue/rte 2026-09-01T00:39:30,211 copying lm_eval/tasks/glue/rte/default.yaml -> build/lib/lm_eval/tasks/glue/rte 2026-09-01T00:39:30,213 creating build/lib/lm_eval/tasks/glue/qnli 2026-09-01T00:39:30,214 copying lm_eval/tasks/glue/qnli/default.yaml -> build/lib/lm_eval/tasks/glue/qnli 2026-09-01T00:39:30,216 creating build/lib/lm_eval/tasks/glue/sst2 2026-09-01T00:39:30,218 copying lm_eval/tasks/glue/sst2/default.yaml -> build/lib/lm_eval/tasks/glue/sst2 2026-09-01T00:39:30,220 creating build/lib/lm_eval/tasks/glue/mrpc 2026-09-01T00:39:30,221 copying lm_eval/tasks/glue/mrpc/default.yaml -> build/lib/lm_eval/tasks/glue/mrpc 2026-09-01T00:39:30,223 creating build/lib/lm_eval/tasks/glue/cola 2026-09-01T00:39:30,225 copying lm_eval/tasks/glue/cola/default.yaml -> build/lib/lm_eval/tasks/glue/cola 2026-09-01T00:39:30,227 copying lm_eval/tasks/qasper/freeform.yaml -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:39:30,230 copying lm_eval/tasks/qasper/bool.yaml -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:39:30,232 copying lm_eval/tasks/hellaswag/hellaswag.yaml -> build/lib/lm_eval/tasks/hellaswag 2026-09-01T00:39:30,235 copying lm_eval/tasks/esbbq/esbbq_ses.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,237 copying lm_eval/tasks/esbbq/esbbq_nationality.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,240 copying lm_eval/tasks/esbbq/esbbq_age.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,242 copying lm_eval/tasks/esbbq/esbbq_disability_status.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,244 copying lm_eval/tasks/esbbq/esbbq_religion.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,247 copying lm_eval/tasks/esbbq/esbbq_gender.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,249 copying lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,251 copying lm_eval/tasks/esbbq/esbbq.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,254 copying lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,256 copying lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,259 copying lm_eval/tasks/esbbq/esbbq_spanish_region.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:30,261 copying lm_eval/tasks/jfinqa/jfinqa_temporal.yaml -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:39:30,264 copying lm_eval/tasks/jfinqa/jfinqa_numerical.yaml -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:39:30,266 copying lm_eval/tasks/jfinqa/jfinqa_consistency.yaml -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:39:30,268 copying lm_eval/tasks/jfinqa/_jfinqa.yaml -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:39:30,271 creating build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,272 copying lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,274 copying lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,277 copying lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,279 copying lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,281 copying lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,284 copying lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,287 copying lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,289 copying lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,292 copying lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,294 copying lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,297 copying lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,299 copying lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,301 copying lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,304 copying lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,306 copying lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,308 copying lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,311 copying lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,313 copying lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,315 copying lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,317 copying lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,320 copying lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,322 copying lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,325 copying lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,327 copying lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,329 copying lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,332 copying lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,334 copying lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,337 copying lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,339 copying lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,341 copying lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,344 copying lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,346 copying lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,349 copying lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,351 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,353 copying lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,356 copying lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,358 copying lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,360 copying lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,363 copying lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,365 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,367 copying lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,369 copying lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,371 copying lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,374 copying lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,376 copying lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,378 copying lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,381 copying lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,383 copying lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,385 copying lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,388 copying lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,390 copying lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,392 copying lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,395 copying lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,397 copying lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,400 copying lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,402 copying lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,404 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,407 copying lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,410 copying lm_eval/tasks/bigbench/generate_until/color.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,412 copying lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,415 copying lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,417 copying lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,420 copying lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,422 copying lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,425 copying lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,427 copying lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,429 copying lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,432 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,434 copying lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,436 copying lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,438 copying lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,441 copying lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,443 copying lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,445 copying lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,448 copying lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,450 copying lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,452 copying lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,455 copying lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,457 copying lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,460 copying lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,462 copying lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,464 copying lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,467 copying lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,469 copying lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,472 copying lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,474 copying lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,476 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,478 copying lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,481 copying lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,483 copying lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,486 copying lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,488 copying lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,490 copying lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,493 copying lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,495 copying lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,497 copying lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,500 copying lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,502 copying lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,505 copying lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,508 copying lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,510 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,512 copying lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,514 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,517 copying lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,519 copying lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,521 copying lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,523 copying lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,526 copying lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,528 copying lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,531 copying lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,533 copying lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,536 copying lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,538 copying lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,541 copying lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,543 copying lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,545 copying lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,547 copying lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,550 copying lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,552 copying lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,555 copying lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,557 copying lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,560 copying lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,562 copying lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,564 copying lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,566 copying lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,569 copying lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,571 copying lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,573 copying lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,576 copying lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,578 copying lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,580 copying lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,583 copying lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,586 copying lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,588 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,590 copying lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,593 copying lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,595 copying lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,598 copying lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,600 copying lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,602 copying lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,605 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,607 copying lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,610 copying lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,612 copying lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,615 copying lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,617 copying lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,619 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,622 copying lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,624 copying lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,627 copying lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,629 copying lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,631 copying lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,633 copying lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,636 copying lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,638 copying lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,640 copying lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,642 copying lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,645 copying lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,647 copying lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,650 copying lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,652 copying lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,654 copying lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,657 copying lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,659 copying lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,661 copying lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,664 copying lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,666 copying lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:39:30,668 creating build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,669 copying lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,672 copying lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,674 copying lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,677 copying lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,679 copying lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,682 copying lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,684 copying lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,686 copying lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,689 copying lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,691 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,694 copying lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,696 copying lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,698 copying lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,701 copying lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,703 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,705 copying lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,707 copying lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,710 copying lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,712 copying lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,714 copying lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,717 copying lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,719 copying lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,721 copying lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,724 copying lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,726 copying lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,729 copying lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,731 copying lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,733 copying lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,735 copying lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,738 copying lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,740 copying lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,742 copying lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,745 copying lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,747 copying lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,749 copying lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,752 copying lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,754 copying lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,756 copying lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,759 copying lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,761 copying lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,764 copying lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,767 copying lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,769 copying lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,772 copying lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,774 copying lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,777 copying lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,779 copying lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,782 copying lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,785 copying lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,787 copying lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,790 copying lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,792 copying lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,795 copying lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,797 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,799 copying lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,802 copying lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,804 copying lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,806 copying lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,808 copying lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,811 copying lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,813 copying lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,816 copying lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,818 copying lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,820 copying lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,823 copying lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,825 copying lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,827 copying lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,829 copying lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,831 copying lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,834 copying lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,836 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,838 copying lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,841 copying lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,844 copying lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,847 copying lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,849 copying lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,851 copying lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,854 copying lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,856 copying lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,858 copying lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,860 copying lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,863 copying lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,865 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,867 copying lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,870 copying lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,872 copying lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,874 copying lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,877 copying lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,879 copying lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,882 copying lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,884 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,886 copying lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,888 copying lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,891 copying lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,893 copying lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,895 copying lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,897 copying lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,900 copying lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,902 copying lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,904 copying lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,907 copying lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,909 copying lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,911 copying lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,913 copying lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,915 copying lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,918 copying lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,920 copying lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,923 copying lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,925 copying lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,927 copying lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,930 copying lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,932 copying lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,934 copying lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,936 copying lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,939 copying lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,941 copying lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,943 copying lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,945 copying lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,948 copying lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:39:30,950 copying lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,952 copying lm_eval/tasks/e2lmc/noor/_noor_stem.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,955 copying lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,957 copying lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,959 copying lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,961 copying lm_eval/tasks/e2lmc/noor/_noor.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,964 copying lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,966 copying lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,968 copying lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,970 copying lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,972 copying lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,974 copying lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,977 copying lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,979 copying lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:30,981 copying lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:39:30,983 creating build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:39:30,985 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:39:30,987 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:39:30,989 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:39:30,992 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:39:30,994 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:39:30,996 creating build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:39:30,997 copying lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:39:30,999 copying lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:39:31,002 copying lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:39:31,005 copying lm_eval/tasks/leaderboard/leaderboard.yaml -> build/lib/lm_eval/tasks/leaderboard 2026-09-01T00:39:31,008 copying lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:39:31,010 copying lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:39:31,013 copying lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:39:31,015 copying lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:39:31,018 copying lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:31,020 copying lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:31,022 copying lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:31,025 copying lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:31,027 copying lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:31,029 copying lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:31,031 copying lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:31,033 copying lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:31,037 copying lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:39:31,039 copying lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:39:31,042 copying lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:39:31,044 copying lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:39:31,046 copying lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:39:31,048 copying lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:39:31,050 copying lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:39:31,052 creating build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,053 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,056 copying lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,058 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,061 copying lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,063 copying lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,065 copying lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,068 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,070 copying lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,072 copying lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,075 copying lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,077 copying lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,079 copying lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,082 copying lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,084 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,086 copying lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,089 copying lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,091 copying lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,093 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,095 copying lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,098 copying lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,100 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,102 copying lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,104 copying lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,106 copying lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,108 copying lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:31,111 copying lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,113 copying lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,115 copying lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,117 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,119 copying lm_eval/tasks/blimp/intransitive.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,121 copying lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,124 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,126 copying lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,128 copying lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,130 copying lm_eval/tasks/blimp/transitive.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,132 copying lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,135 copying lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,137 copying lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,139 copying lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,141 copying lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,144 copying lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,146 copying lm_eval/tasks/blimp/adjunct_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,148 copying lm_eval/tasks/blimp/inchoative.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,150 copying lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,152 copying lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,154 copying lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,157 copying lm_eval/tasks/blimp/_blimp.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,159 copying lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,161 copying lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,164 copying lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,166 copying lm_eval/tasks/blimp/wh_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,168 copying lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,170 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,172 copying lm_eval/tasks/blimp/causative.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,174 copying lm_eval/tasks/blimp/npi_present_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,176 copying lm_eval/tasks/blimp/npi_present_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,178 copying lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,180 copying lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,182 copying lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,185 copying lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,187 copying lm_eval/tasks/blimp/drop_argument.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,189 copying lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,191 copying lm_eval/tasks/blimp/passive_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,194 copying lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,196 copying lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,198 copying lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,200 copying lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,202 copying lm_eval/tasks/blimp/only_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,205 copying lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,207 copying lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,209 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,211 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,214 copying lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,216 copying lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,218 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,220 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,223 copying lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,225 copying lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,227 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,229 copying lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,232 copying lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,235 copying lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,237 copying lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,239 copying lm_eval/tasks/blimp/passive_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,241 copying lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,243 copying lm_eval/tasks/blimp/complex_NP_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,245 copying lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,247 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,249 copying lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,252 copying lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,254 copying lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,256 copying lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,258 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:31,261 copying lm_eval/tasks/nerel-bench/ru_relation_extraction.yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:39:31,263 copying lm_eval/tasks/nerel-bench/ru_entity_recognition.yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:39:31,265 copying lm_eval/tasks/nerel-bench/ru_relation_definition.yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:39:31,267 copying lm_eval/tasks/nerel-bench/ru_entity_definition.yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:39:31,270 copying lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:31,272 copying lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:31,274 copying lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:31,276 copying lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:31,278 copying lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:31,281 copying lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:31,283 copying lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:31,285 copying lm_eval/tasks/minerva_math/minerva_math500.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:31,287 creating build/lib/lm_eval/tasks/unscramble 2026-09-01T00:39:31,288 copying lm_eval/tasks/unscramble/cycle_letters.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:39:31,291 copying lm_eval/tasks/unscramble/anagrams2.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:39:31,293 copying lm_eval/tasks/unscramble/reversed_words.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:39:31,295 copying lm_eval/tasks/unscramble/anagrams1.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:39:31,297 copying lm_eval/tasks/unscramble/random_insertion.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:39:31,300 copying lm_eval/tasks/squadv2/squadv2.yaml -> build/lib/lm_eval/tasks/squadv2 2026-09-01T00:39:31,302 copying lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,304 copying lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,307 copying lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,309 copying lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,311 copying lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,313 copying lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,315 copying lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,318 copying lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,320 copying lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,322 copying lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,324 copying lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,327 copying lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,329 copying lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,331 copying lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,333 copying lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:31,335 creating build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,336 copying lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,338 copying lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,340 copying lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,342 copying lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,344 copying lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,346 copying lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,348 copying lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,351 copying lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,353 copying lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,355 copying lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,357 copying lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,359 copying lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,361 copying lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,364 copying lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,366 copying lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,368 copying lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,370 copying lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,373 copying lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,375 copying lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,378 copying lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,380 copying lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,382 copying lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,384 copying lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,387 copying lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,389 copying lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,391 copying lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,393 copying lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,395 copying lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,397 copying lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,400 copying lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,402 copying lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,404 copying lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,406 copying lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,408 copying lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,410 copying lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,413 copying lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,415 copying lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,417 copying lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,419 copying lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,422 copying lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,424 copying lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,426 copying lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,428 copying lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,431 copying lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,433 copying lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,435 copying lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,438 copying lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,440 copying lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,443 copying lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,445 copying lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,447 copying lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,450 copying lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,452 copying lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,455 copying lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,457 copying lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,459 copying lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,461 copying lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,464 copying lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,466 copying lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,468 copying lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,471 copying lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,473 copying lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,475 copying lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,478 copying lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,480 copying lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,482 copying lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,484 copying lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,486 copying lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,489 copying lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,491 copying lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,493 copying lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,495 copying lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,497 copying lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,500 copying lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,502 copying lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,504 copying lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,507 copying lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,509 copying lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,511 copying lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,514 copying lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,516 copying lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,519 copying lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,521 copying lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,523 copying lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,526 copying lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,528 copying lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,530 copying lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,533 copying lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,535 copying lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,538 copying lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,540 copying lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,542 copying lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,545 copying lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,547 copying lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,550 copying lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,552 copying lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,554 copying lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,557 copying lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,559 copying lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,562 copying lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,564 copying lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:31,567 copying lm_eval/tasks/medmcqa/medmcqa.yaml -> build/lib/lm_eval/tasks/medmcqa 2026-09-01T00:39:31,569 creating build/lib/lm_eval/tasks/polemo2 2026-09-01T00:39:31,570 copying lm_eval/tasks/polemo2/polemo2_out.yaml -> build/lib/lm_eval/tasks/polemo2 2026-09-01T00:39:31,573 copying lm_eval/tasks/polemo2/polemo2_in.yaml -> build/lib/lm_eval/tasks/polemo2 2026-09-01T00:39:31,575 creating build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:39:31,577 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:39:31,580 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:39:31,582 copying lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:39:31,584 copying lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:39:31,587 creating build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,589 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,591 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,594 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,596 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,599 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,601 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,603 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,606 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,608 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,611 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,613 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,616 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,618 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:31,621 creating build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,622 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,625 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,627 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,629 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,632 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,634 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,636 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,639 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,641 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,644 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,646 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,649 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,651 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,654 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:31,656 creating build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,657 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,660 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,662 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,665 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,667 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,670 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,672 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,674 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,677 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,680 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,682 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,684 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,687 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,689 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:31,691 creating build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,692 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,695 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,697 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,700 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,702 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,704 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,707 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,709 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,711 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,714 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,716 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,719 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,721 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:31,723 creating build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:31,724 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:31,727 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:31,729 copying lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:31,732 copying lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:31,734 copying lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:31,737 copying lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:31,739 copying lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:31,741 copying lm_eval/tasks/libra/ru_gsm100.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,744 copying lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,746 copying lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,749 copying lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,751 copying lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,754 copying lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,756 copying lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,758 copying lm_eval/tasks/libra/ru_qasper.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,761 copying lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,763 copying lm_eval/tasks/libra/ru_quality.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,766 copying lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,768 copying lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,770 copying lm_eval/tasks/libra/librusec_history.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,773 copying lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,775 copying lm_eval/tasks/libra/matreshka_names.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,777 copying lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,780 copying lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,782 copying lm_eval/tasks/libra/long_context_multiq.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,784 copying lm_eval/tasks/libra/passkey.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,787 copying lm_eval/tasks/libra/librusec_mhqa.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,789 copying lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,792 copying lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:31,794 copying lm_eval/tasks/winogrande/default.yaml -> build/lib/lm_eval/tasks/winogrande 2026-09-01T00:39:31,797 creating build/lib/lm_eval/tasks/mc_taco 2026-09-01T00:39:31,798 copying lm_eval/tasks/mc_taco/default.yaml -> build/lib/lm_eval/tasks/mc_taco 2026-09-01T00:39:31,801 copying lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,803 copying lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,805 copying lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,808 copying lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,810 copying lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,812 copying lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,815 copying lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,818 copying lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,820 copying lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,823 copying lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:31,825 creating build/lib/lm_eval/tasks/bangla 2026-09-01T00:39:31,827 copying lm_eval/tasks/bangla/bangla_openbookqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:39:31,829 copying lm_eval/tasks/bangla/bangla_mmlu.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:39:31,832 copying lm_eval/tasks/bangla/bangla_commonsenseqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:39:31,835 copying lm_eval/tasks/bangla/bangla_boolqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:39:31,837 copying lm_eval/tasks/bangla/bangla_piqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:39:31,842 copying lm_eval/tasks/README.md -> build/lib/lm_eval/tasks 2026-09-01T00:39:31,849 copying lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:31,851 copying lm_eval/tasks/hendrycks_ethics/README.md -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:31,855 copying lm_eval/tasks/acpbench/README.md -> build/lib/lm_eval/tasks/acpbench 2026-09-01T00:39:31,858 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:31,860 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:31,863 copying lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:31,867 copying lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:31,869 copying lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:31,872 copying lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:31,874 copying lm_eval/tasks/mbpp/README.md -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:39:31,878 copying lm_eval/tasks/truthfulqa/README.md -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:39:31,881 copying lm_eval/tasks/siqa/README.md -> build/lib/lm_eval/tasks/siqa 2026-09-01T00:39:31,884 copying lm_eval/tasks/c4/README.md -> build/lib/lm_eval/tasks/c4 2026-09-01T00:39:31,887 copying lm_eval/tasks/mmlu-redux/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:31,889 copying lm_eval/tasks/mmlu-redux/generative/README.md -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:31,892 copying lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:39:31,909 copying lm_eval/tasks/blimp_nl/_template_yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:31,911 copying lm_eval/tasks/blimp_nl/README.md -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:39:31,914 copying lm_eval/tasks/ulqa/README.md -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:39:31,917 copying lm_eval/tasks/lingoly/README.md -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:39:31,920 copying lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:31,923 copying lm_eval/tasks/mmlu-pro-plus/README.md -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:31,926 copying lm_eval/tasks/mimic_repsum/README.md -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:39:31,929 copying lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:31,931 copying lm_eval/tasks/egymmlu/README.md -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:39:31,935 copying lm_eval/tasks/aime/README.md -> build/lib/lm_eval/tasks/aime 2026-09-01T00:39:31,938 copying lm_eval/tasks/icelandic_winogrande/README.md -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:39:31,942 copying lm_eval/tasks/wmt2016/README.md -> build/lib/lm_eval/tasks/wmt2016 2026-09-01T00:39:31,945 copying lm_eval/tasks/xcopa/README.md -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:39:31,948 copying lm_eval/tasks/eus_exams/eus_exams -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:31,950 copying lm_eval/tasks/eus_exams/eus_exams_eu -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:31,952 copying lm_eval/tasks/eus_exams/eus_exams_es -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:31,955 copying lm_eval/tasks/eus_exams/README.md -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:39:31,958 copying lm_eval/tasks/cruxeval/README.md -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:39:31,961 copying lm_eval/tasks/cruxeval/cruxeval_common_yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:39:31,964 copying lm_eval/tasks/translation/wmt_common_yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:31,966 copying lm_eval/tasks/translation/README.md -> build/lib/lm_eval/tasks/translation 2026-09-01T00:39:31,970 copying lm_eval/tasks/galician_bench/README.md -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:39:31,974 copying lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:31,976 copying lm_eval/tasks/greekmmlu/README.md -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:31,979 copying lm_eval/tasks/greekmmlu/_default_greekmmlu_template_yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:39:31,982 copying lm_eval/tasks/openai-mmmlu/languages.json -> build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:39:31,984 copying lm_eval/tasks/openai-mmmlu/subjects.json -> build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:39:31,987 copying lm_eval/tasks/openai-mmmlu/README.md -> build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:39:31,990 copying lm_eval/tasks/openai-mmmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:31,994 copying lm_eval/tasks/ruler/README.md -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:39:32,000 copying lm_eval/tasks/openbookqa/README.md -> build/lib/lm_eval/tasks/openbookqa 2026-09-01T00:39:32,002 copying lm_eval/tasks/turblimp/_template_yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:32,004 copying lm_eval/tasks/turblimp/README.md -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:39:32,006 copying lm_eval/tasks/cabbq/README.md -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:32,008 copying lm_eval/tasks/cabbq/_cabbq_common_yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:39:32,012 copying lm_eval/tasks/tmlu/README.md -> build/lib/lm_eval/tasks/tmlu 2026-09-01T00:39:32,014 copying lm_eval/tasks/tmlu/subject.tsv -> build/lib/lm_eval/tasks/tmlu 2026-09-01T00:39:32,016 copying lm_eval/tasks/tmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:39:32,020 copying lm_eval/tasks/eq_bench/README.md -> build/lib/lm_eval/tasks/eq_bench 2026-09-01T00:39:32,024 copying lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:32,026 copying lm_eval/tasks/catalan_bench/README.md -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:32,029 copying lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:39:32,033 copying lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:32,036 copying lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:39:32,038 copying lm_eval/tasks/babilong/README.md -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:32,041 copying lm_eval/tasks/babilong/_babilong_common_yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:39:32,044 copying lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:32,046 copying lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:39:32,050 copying lm_eval/tasks/mgsm/README.md -> build/lib/lm_eval/tasks/mgsm 2026-09-01T00:39:32,053 copying lm_eval/tasks/mgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/mgsm 2026-09-01T00:39:32,056 copying lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:32,058 copying lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:32,061 copying lm_eval/tasks/mgsm/direct/direct_yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:32,064 copying lm_eval/tasks/meddialog/README.md -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:39:32,068 copying lm_eval/tasks/belebele/_default_template_yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:32,071 copying lm_eval/tasks/belebele/README.md -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:39:32,074 copying lm_eval/tasks/paws-x/pawsx_template_yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:32,078 copying lm_eval/tasks/paws-x/README.md -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:39:32,081 copying lm_eval/tasks/copal_id/README.md -> build/lib/lm_eval/tasks/copal_id 2026-09-01T00:39:32,084 copying lm_eval/tasks/afrimgsm/README.md -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:39:32,087 copying lm_eval/tasks/afrimgsm/run.sh -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:39:32,090 copying lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:39:32,093 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:32,095 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:32,098 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:32,100 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:32,103 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:32,106 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:32,108 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:32,111 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:32,113 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:32,116 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:32,119 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:32,121 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:32,124 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:32,126 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:32,129 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:32,131 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:32,133 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:32,136 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:32,138 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:32,141 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:32,144 copying lm_eval/tasks/mlqa/README.md -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:32,147 copying lm_eval/tasks/mlqa/mlqa_common_yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:39:32,150 copying lm_eval/tasks/pisa/_template_yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:32,153 copying lm_eval/tasks/pisa/README.md -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:39:32,156 copying lm_eval/tasks/click/README.md -> build/lib/lm_eval/tasks/click 2026-09-01T00:39:32,159 copying lm_eval/tasks/click/click_lang/_default_click_lang_yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:39:32,162 copying lm_eval/tasks/click/click_cul/_default_click_cul_yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:39:32,165 copying lm_eval/tasks/winogender/README.md -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:39:32,170 copying lm_eval/tasks/hrm8k/README.md -> build/lib/lm_eval/tasks/hrm8k 2026-09-01T00:39:32,173 copying lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:39:32,176 copying lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:39:32,180 copying lm_eval/tasks/indicxnli/README.md -> build/lib/lm_eval/tasks/indicxnli 2026-09-01T00:39:32,182 copying lm_eval/tasks/xstorycloze/README.md -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:39:32,185 copying lm_eval/tasks/groundcocoa/README.md -> build/lib/lm_eval/tasks/groundcocoa 2026-09-01T00:39:32,189 copying lm_eval/tasks/noreval/noreval.jpg -> build/lib/lm_eval/tasks/noreval 2026-09-01T00:39:32,202 copying lm_eval/tasks/noreval/README.md -> build/lib/lm_eval/tasks/noreval 2026-09-01T00:39:32,206 copying lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:39:32,209 copying lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/lib/lm_eval/tasks/noreval/norsumm 2026-09-01T00:39:32,212 copying lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa 2026-09-01T00:39:32,216 copying lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:39:32,219 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-09-01T00:39:32,223 copying lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/lib/lm_eval/tasks/noreval/tatoeba 2026-09-01T00:39:32,226 copying lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:32,228 copying lm_eval/tasks/noreval/ask_gec/README.md -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:32,232 copying lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:32,234 copying lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa 2026-09-01T00:39:32,239 copying lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:39:32,242 copying lm_eval/tasks/noreval/norec/_norec_yaml -> build/lib/lm_eval/tasks/noreval/norec 2026-09-01T00:39:32,245 copying lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/lib/lm_eval/tasks/noreval/noridiom 2026-09-01T00:39:32,248 copying lm_eval/tasks/fda/README.md -> build/lib/lm_eval/tasks/fda 2026-09-01T00:39:32,252 copying lm_eval/tasks/bear/README.md -> build/lib/lm_eval/tasks/bear 2026-09-01T00:39:32,254 copying lm_eval/tasks/lambada_cloze/README.md -> build/lib/lm_eval/tasks/lambada_cloze 2026-09-01T00:39:32,257 copying lm_eval/tasks/babi/README.md -> build/lib/lm_eval/tasks/babi 2026-09-01T00:39:32,260 copying lm_eval/tasks/mastermind/README.md -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:39:32,263 copying lm_eval/tasks/xquad/README.md -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:32,267 copying lm_eval/tasks/xquad/xquad_common_yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:39:32,269 copying lm_eval/tasks/afrixnli/README.md -> build/lib/lm_eval/tasks/afrixnli 2026-09-01T00:39:32,274 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:32,279 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:32,282 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:32,286 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:32,289 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:32,293 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:32,297 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:32,299 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:32,302 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:32,306 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:32,309 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:32,312 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:32,316 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:32,319 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:32,323 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:32,326 copying lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:32,328 copying lm_eval/tasks/arab_culture/README.md -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:39:32,333 copying lm_eval/tasks/pubmedqa/README.md -> build/lib/lm_eval/tasks/pubmedqa 2026-09-01T00:39:32,336 copying lm_eval/tasks/lm_syneval/_template_yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:32,339 copying lm_eval/tasks/lm_syneval/README.md -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:39:32,342 copying lm_eval/tasks/agieval/README.md -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:39:32,346 copying lm_eval/tasks/zhoblimp/_template_yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:32,348 copying lm_eval/tasks/zhoblimp/README.md -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:39:32,352 copying lm_eval/tasks/mts_dialog/README.md -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:39:32,355 copying lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:32,357 copying lm_eval/tasks/med_concepts_qa/README.md -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:32,361 copying lm_eval/tasks/bhs/_template_yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:32,363 copying lm_eval/tasks/bhs/README.md -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:39:32,366 copying lm_eval/tasks/toksuite/README.md -> build/lib/lm_eval/tasks/toksuite 2026-09-01T00:39:32,370 copying lm_eval/tasks/evalita_llm/_te_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,373 copying lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,375 copying lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,377 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,380 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,382 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,384 copying lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,386 copying lm_eval/tasks/evalita_llm/_re_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,389 copying lm_eval/tasks/evalita_llm/README.md -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,391 copying lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,394 copying lm_eval/tasks/evalita_llm/_at_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,396 copying lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,398 copying lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,401 copying lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,403 copying lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,405 copying lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,407 copying lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:39:32,409 copying lm_eval/tasks/infinitebench/_infinitebench_common_yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:32,411 copying lm_eval/tasks/infinitebench/README.md -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:39:32,414 copying lm_eval/tasks/wsc273/README.md -> build/lib/lm_eval/tasks/wsc273 2026-09-01T00:39:32,418 copying lm_eval/tasks/logiqa/README.md -> build/lib/lm_eval/tasks/logiqa 2026-09-01T00:39:32,421 copying lm_eval/tasks/code_x_glue/code-text/_default_template_yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:32,424 copying lm_eval/tasks/code_x_glue/code-text/README.md -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:32,427 copying lm_eval/tasks/histoires_morales/README.md -> build/lib/lm_eval/tasks/histoires_morales 2026-09-01T00:39:32,431 copying lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:39:32,434 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:32,437 copying lm_eval/tasks/truthfulqa-multi/README.md -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:32,440 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:32,443 copying lm_eval/tasks/gpqa/README.md -> build/lib/lm_eval/tasks/gpqa 2026-09-01T00:39:32,446 copying lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:32,449 copying lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:32,453 copying lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:32,456 copying lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:32,460 copying lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:39:32,464 copying lm_eval/tasks/scrolls/README.md -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:39:32,467 copying lm_eval/tasks/hendrycks_math/README.md -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:32,471 copying lm_eval/tasks/mmlu_prox/README.md -> build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:39:32,475 copying lm_eval/tasks/mmlu_prox/id/_id_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:32,478 copying lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:32,481 copying lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:32,484 copying lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:32,486 copying lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:32,489 copying lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:32,492 copying lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:32,494 copying lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:32,497 copying lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:32,499 copying lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:32,502 copying lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:32,505 copying lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:32,508 copying lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:32,511 copying lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:32,513 copying lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:32,517 copying lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:32,519 copying lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:32,522 copying lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:32,525 copying lm_eval/tasks/mmlu_prox/af/_af_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:32,528 copying lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:32,531 copying lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:32,534 copying lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:32,536 copying lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:32,540 copying lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:32,542 copying lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:32,544 copying lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:32,547 copying lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:32,550 copying lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:32,553 copying lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/template 2026-09-01T00:39:32,556 copying lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:32,559 copying lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:32,562 copying lm_eval/tasks/mmlu_prox/te/_te_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:32,564 copying lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:32,567 copying lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:32,569 copying lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:32,573 copying lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:32,575 copying lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:32,578 copying lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:32,581 copying lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:32,584 copying lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:32,586 copying lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:32,589 copying lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:32,592 copying lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:32,594 copying lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:32,596 copying lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:32,599 copying lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:32,602 copying lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:32,605 copying lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:32,608 copying lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:32,610 copying lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:32,613 copying lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:32,616 copying lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:32,619 copying lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:32,621 copying lm_eval/tasks/mmlu_prox/it/_it_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:32,624 copying lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:32,627 copying lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:32,629 copying lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:32,633 copying lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:32,636 copying lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:32,638 copying lm_eval/tasks/inverse_scaling/_some_results -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:32,641 copying lm_eval/tasks/inverse_scaling/README.md -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:32,644 copying lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:32,646 copying lm_eval/tasks/xnli/README.md -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:32,649 copying lm_eval/tasks/xnli/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:39:32,653 copying lm_eval/tasks/tinyBenchmarks/README.md -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:32,658 copying lm_eval/tasks/kmmlu/README.md -> build/lib/lm_eval/tasks/kmmlu 2026-09-01T00:39:32,661 copying lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:32,663 copying lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:32,666 copying lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:32,669 copying lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:32,671 copying lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:32,674 copying lm_eval/tasks/meqsum/README.md -> build/lib/lm_eval/tasks/meqsum 2026-09-01T00:39:32,678 copying lm_eval/tasks/glianorex/README.md -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:39:32,681 copying lm_eval/tasks/egyhellaswag/README.md -> build/lib/lm_eval/tasks/egyhellaswag 2026-09-01T00:39:32,684 copying lm_eval/tasks/swde/README.md -> build/lib/lm_eval/tasks/swde 2026-09-01T00:39:32,688 copying lm_eval/tasks/cnn_dailymail/README.md -> build/lib/lm_eval/tasks/cnn_dailymail 2026-09-01T00:39:32,693 copying lm_eval/tasks/aclue/_default_template_yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:32,695 copying lm_eval/tasks/aclue/README.md -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:39:32,698 copying lm_eval/tasks/arabic_leaderboard_light/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:39:32,713 copying lm_eval/tasks/lambada/README.md -> build/lib/lm_eval/tasks/lambada 2026-09-01T00:39:32,716 copying lm_eval/tasks/chartqa/README.md -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:39:32,719 copying lm_eval/tasks/jsonschema_bench/README.md -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:32,722 copying lm_eval/tasks/physics_gre/_physics_gre_template_yaml -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:39:32,724 copying lm_eval/tasks/physics_gre/README.md -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:39:32,728 copying lm_eval/tasks/legalbench/README.md -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:32,730 copying lm_eval/tasks/legalbench/_legalbench_template_yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:39:32,733 copying lm_eval/tasks/slr_bench/slr_bench_common_yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:39:32,735 copying lm_eval/tasks/slr_bench/README.md -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:39:32,738 copying lm_eval/tasks/fld/README.md -> build/lib/lm_eval/tasks/fld 2026-09-01T00:39:32,741 copying lm_eval/tasks/squad_completion/README.md -> build/lib/lm_eval/tasks/squad_completion 2026-09-01T00:39:32,744 copying lm_eval/tasks/asdiv/README.md -> build/lib/lm_eval/tasks/asdiv 2026-09-01T00:39:32,747 copying lm_eval/tasks/global_mmlu/README.md -> build/lib/lm_eval/tasks/global_mmlu 2026-09-01T00:39:32,750 copying lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:32,753 copying lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:32,757 copying lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:32,761 copying lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:32,764 copying lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:32,766 copying lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:32,769 copying lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:32,773 copying lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:32,776 copying lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:32,779 copying lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:32,783 copying lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:32,786 copying lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:32,790 copying lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:32,792 copying lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:32,796 copying lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:32,799 copying lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:32,802 copying lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:32,806 copying lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:32,809 copying lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:32,812 copying lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:32,815 copying lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:32,819 copying lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:32,823 copying lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:32,826 copying lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:32,828 copying lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:32,832 copying lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:32,835 copying lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:32,839 copying lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:32,842 copying lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:32,845 copying lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:32,848 copying lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:32,851 copying lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:32,855 copying lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:32,858 copying lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:32,862 copying lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:32,864 copying lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:32,868 copying lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:32,871 copying lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:32,875 copying lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:32,878 copying lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:32,881 copying lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:39:32,884 copying lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:39:32,888 copying lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:39:32,893 copying lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:39:32,896 copying lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:39:32,900 copying lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:39:32,902 copying lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:39:32,906 copying lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:39:32,909 copying lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:39:32,913 copying lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:39:32,916 copying lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:39:32,920 copying lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:39:32,924 copying lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:39:32,928 copying lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:39:32,932 copying lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:39:32,937 copying lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:39:32,945 copying lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:39:32,951 copying lm_eval/tasks/longbench2/_longbench_common_yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:32,954 copying lm_eval/tasks/longbench2/README.md -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:39:32,958 copying lm_eval/tasks/japanese_leaderboard/README.md -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:32,964 copying lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:39:32,968 copying lm_eval/tasks/basque_bench/README.md -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:39:32,972 copying lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:39:32,976 copying lm_eval/tasks/french_bench/_default_template_yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:32,980 copying lm_eval/tasks/french_bench/README.md -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:39:32,984 copying lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:32,987 copying lm_eval/tasks/darijammlu/README.md -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:39:32,992 copying lm_eval/tasks/kormedmcqa/_template_yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:39:32,995 copying lm_eval/tasks/kormedmcqa/README.md -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:39:32,999 copying lm_eval/tasks/cmmlu/_default_template_yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:33,002 copying lm_eval/tasks/cmmlu/README.md -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:39:33,006 copying lm_eval/tasks/mmmu/_template_yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:33,009 copying lm_eval/tasks/mmmu/README.md -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:39:33,013 copying lm_eval/tasks/eus_trivia/README.md -> build/lib/lm_eval/tasks/eus_trivia 2026-09-01T00:39:33,018 copying lm_eval/tasks/include/README.md -> build/lib/lm_eval/tasks/include 2026-09-01T00:39:33,022 copying lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:39:33,024 copying lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:39:33,028 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:39:33,031 copying lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:39:33,034 copying lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:39:33,037 copying lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:39:33,041 copying lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:39:33,043 copying lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:39:33,047 copying lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:39:33,050 copying lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:39:33,052 copying lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:39:33,056 copying lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:39:33,059 copying lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:39:33,062 copying lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:39:33,065 copying lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:39:33,068 copying lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:39:33,073 copying lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:39:33,076 copying lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:39:33,078 copying lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:39:33,082 copying lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:39:33,085 copying lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:39:33,089 copying lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:39:33,093 copying lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:39:33,096 copying lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:39:33,099 copying lm_eval/tasks/include/few_shot_en/North Macedonian/_north_macedonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:39:33,103 copying lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:39:33,106 copying lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:39:33,109 copying lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:39:33,112 copying lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:39:33,115 copying lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:39:33,119 copying lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:39:33,122 copying lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:39:33,126 copying lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:39:33,129 copying lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:39:33,132 copying lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:39:33,135 copying lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:39:33,138 copying lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:39:33,142 copying lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:39:33,145 copying lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:39:33,149 copying lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:39:33,152 copying lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:39:33,155 copying lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:39:33,158 copying lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:39:33,162 copying lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:39:33,166 copying lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:39:33,169 copying lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:39:33,173 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:39:33,176 copying lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:39:33,179 copying lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:39:33,182 copying lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:39:33,186 copying lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:39:33,190 copying lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:39:33,192 copying lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:39:33,196 copying lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:39:33,199 copying lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:39:33,202 copying lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:39:33,204 copying lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:39:33,207 copying lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:39:33,211 copying lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:39:33,214 copying lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:39:33,217 copying lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:39:33,220 copying lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:39:33,224 copying lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:39:33,227 copying lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:39:33,230 copying lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:39:33,233 copying lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:39:33,237 copying lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:39:33,240 copying lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:39:33,242 copying lm_eval/tasks/include/few_shot_og/North Macedonian/_north_macedonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:39:33,245 copying lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:39:33,249 copying lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:39:33,252 copying lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:39:33,256 copying lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:39:33,258 copying lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:39:33,262 copying lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:39:33,266 copying lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:39:33,270 copying lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:39:33,274 copying lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:39:33,276 copying lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:39:33,280 copying lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:39:33,284 copying lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:39:33,287 copying lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:39:33,290 copying lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:39:33,293 copying lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:39:33,297 copying lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:39:33,300 copying lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:39:33,303 copying lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:39:33,306 copying lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:39:33,309 copying lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:39:33,312 copying lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:39:33,316 copying lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:39:33,319 copying lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:39:33,322 copying lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:39:33,326 copying lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:39:33,328 copying lm_eval/tasks/include/default/French/_french_template_yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:39:33,332 copying lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:39:33,335 copying lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:39:33,339 copying lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:39:33,343 copying lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:39:33,345 copying lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:39:33,349 copying lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:39:33,352 copying lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:39:33,357 copying lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:39:33,360 copying lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:39:33,363 copying lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:39:33,366 copying lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:39:33,370 copying lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:39:33,374 copying lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:39:33,377 copying lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:39:33,380 copying lm_eval/tasks/include/default/German/_german_template_yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:39:33,384 copying lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:39:33,388 copying lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:39:33,392 copying lm_eval/tasks/include/default/North Macedonian/_north_macedonian_template_yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:39:33,395 copying lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:39:33,398 copying lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:39:33,402 copying lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:39:33,405 copying lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:39:33,409 copying lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:39:33,413 copying lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:39:33,417 copying lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:39:33,420 copying lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:39:33,424 copying lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:39:33,427 copying lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:39:33,431 copying lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:39:33,434 copying lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:39:33,439 copying lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:39:33,441 copying lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:39:33,446 copying lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:39:33,449 copying lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:39:33,453 copying lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:39:33,455 copying lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:39:33,459 copying lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:39:33,463 copying lm_eval/tasks/longbench/README.md -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:39:33,468 copying lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:33,471 copying lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:39:33,474 copying lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:39:33,477 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:33,479 copying lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:33,483 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:39:33,486 copying lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:33,488 copying lm_eval/tasks/okapi/arc_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:39:33,492 copying lm_eval/tasks/kobest/README.md -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:39:33,496 copying lm_eval/tasks/portuguese_bench/README.md -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:39:33,500 copying lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:39:33,503 copying lm_eval/tasks/wmdp/_default_template_yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:39:33,505 copying lm_eval/tasks/wmdp/README.md -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:39:33,509 copying lm_eval/tasks/longproc/_default_yaml_0.5k -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:33,511 copying lm_eval/tasks/longproc/README.md -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:33,515 copying lm_eval/tasks/longproc/_default_yaml_8k -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:33,517 copying lm_eval/tasks/longproc/_default_yaml_2k -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:39:33,520 copying lm_eval/tasks/pile/README.md -> build/lib/lm_eval/tasks/pile 2026-09-01T00:39:33,523 copying lm_eval/tasks/commonsense_qa/README.md -> build/lib/lm_eval/tasks/commonsense_qa 2026-09-01T00:39:33,526 copying lm_eval/tasks/mathqa/README.md -> build/lib/lm_eval/tasks/mathqa 2026-09-01T00:39:33,530 copying lm_eval/tasks/tmmluplus/README.md -> build/lib/lm_eval/tasks/tmmluplus 2026-09-01T00:39:33,532 copying lm_eval/tasks/tmmluplus/subject.tsv -> build/lib/lm_eval/tasks/tmmluplus 2026-09-01T00:39:33,536 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:39:33,539 copying lm_eval/tasks/benchmarks/README.md -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:39:33,542 copying lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-09-01T00:39:33,545 copying lm_eval/tasks/benchmarks/multimedqa/README.md -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:39:33,548 copying lm_eval/tasks/crows_pairs/README.md -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:39:33,552 copying lm_eval/tasks/bertaqa/_bertaqa_template -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:33,554 copying lm_eval/tasks/bertaqa/README.md -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:39:33,557 copying lm_eval/tasks/darijahellaswag/README.md -> build/lib/lm_eval/tasks/darijahellaswag 2026-09-01T00:39:33,561 copying lm_eval/tasks/alghafa/piqa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:39:33,563 copying lm_eval/tasks/alghafa/copa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:39:33,566 copying lm_eval/tasks/bbh/README.md -> build/lib/lm_eval/tasks/bbh 2026-09-01T00:39:33,570 copying lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:39:33,574 copying lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:39:33,576 copying lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:39:33,579 copying lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:39:33,583 copying lm_eval/tasks/discrim_eval/README.md -> build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:39:33,586 copying lm_eval/tasks/arabicmmlu/README.md -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:33,589 copying lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:39:33,592 creating build/lib/lm_eval/tasks/model_written_evals/winogenerated 2026-09-01T00:39:33,594 copying lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/lib/lm_eval/tasks/model_written_evals/winogenerated 2026-09-01T00:39:33,597 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:39:33,600 copying lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:39:33,604 copying lm_eval/tasks/super_glue/README.md -> build/lib/lm_eval/tasks/super_glue 2026-09-01T00:39:33,612 copying lm_eval/tasks/toxigen/README.md -> build/lib/lm_eval/tasks/toxigen 2026-09-01T00:39:33,616 copying lm_eval/tasks/eus_reading/README.md -> build/lib/lm_eval/tasks/eus_reading 2026-09-01T00:39:33,619 copying lm_eval/tasks/ceval/_default_ceval_yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:33,622 copying lm_eval/tasks/ceval/README.md -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:39:33,626 copying lm_eval/tasks/mela/README.md -> build/lib/lm_eval/tasks/mela 2026-09-01T00:39:33,629 copying lm_eval/tasks/aexams/_default_template_yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:33,631 copying lm_eval/tasks/aexams/README.md -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:39:33,634 copying lm_eval/tasks/arc_mt/README.md -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:39:33,637 copying lm_eval/tasks/triviaqa/README.md -> build/lib/lm_eval/tasks/triviaqa 2026-09-01T00:39:33,639 copying lm_eval/tasks/haerae/_default_haerae_yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:33,642 copying lm_eval/tasks/haerae/README.md -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:39:33,644 copying lm_eval/tasks/gsm8k/README.md -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:39:33,648 copying lm_eval/tasks/qa4mre/README.md -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:39:33,651 copying lm_eval/tasks/basqueglue/README.md -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:39:33,654 copying lm_eval/tasks/coqa/README.md -> build/lib/lm_eval/tasks/coqa 2026-09-01T00:39:33,658 copying lm_eval/tasks/afrimmlu/README.md -> build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:39:33,661 copying lm_eval/tasks/afrimmlu/fewshot.sh -> build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:39:33,665 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:39:33,669 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:39:33,672 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:39:33,676 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:39:33,679 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:39:33,682 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:39:33,686 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:39:33,689 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:39:33,693 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:39:33,696 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:39:33,699 copying lm_eval/tasks/headqa/README.md -> build/lib/lm_eval/tasks/headqa 2026-09-01T00:39:33,702 copying lm_eval/tasks/humaneval/README.md -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:39:33,706 copying lm_eval/tasks/gsm8k_platinum/README.md -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:39:33,708 copying lm_eval/tasks/score/README.md -> build/lib/lm_eval/tasks/score 2026-09-01T00:39:33,712 copying lm_eval/tasks/score/NON_GREEDY.md -> build/lib/lm_eval/tasks/score 2026-09-01T00:39:33,716 copying lm_eval/tasks/score/non_greedy.sh -> build/lib/lm_eval/tasks/score 2026-09-01T00:39:33,719 copying lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:39:33,724 copying lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:33,726 copying lm_eval/tasks/score/math/prompt_templates.json -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:39:33,730 copying lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:39:33,733 copying lm_eval/tasks/spanish_bench/README.md -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:39:33,737 copying lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:39:33,740 copying lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:39:33,744 copying lm_eval/tasks/careqa/README.md -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:39:33,748 copying lm_eval/tasks/piqa/README.md -> build/lib/lm_eval/tasks/piqa 2026-09-01T00:39:33,750 copying lm_eval/tasks/global_piqa/README.md -> build/lib/lm_eval/tasks/global_piqa 2026-09-01T00:39:33,754 copying lm_eval/tasks/global_piqa/parallel_generation/_template -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:39:33,758 copying lm_eval/tasks/global_piqa/nonparallel_cloze/_template -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:39:33,761 copying lm_eval/tasks/global_piqa/parallel_cloze/_template -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:39:33,765 copying lm_eval/tasks/global_piqa/nonparallel_generation/_template -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:39:33,767 copying lm_eval/tasks/drop/README.md -> build/lib/lm_eval/tasks/drop 2026-09-01T00:39:33,771 copying lm_eval/tasks/storycloze/README.md -> build/lib/lm_eval/tasks/storycloze 2026-09-01T00:39:33,773 copying lm_eval/tasks/nq_open/README.md -> build/lib/lm_eval/tasks/nq_open 2026-09-01T00:39:33,776 copying lm_eval/tasks/indicparam/README.md -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:33,779 copying lm_eval/tasks/indicparam/_default_indicparam_template_yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:39:33,782 copying lm_eval/tasks/uncheatable_eval/README.md -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:39:33,785 copying lm_eval/tasks/mmlu-redux-spanish/README.md -> build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:39:33,787 copying lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:39:33,790 copying lm_eval/tasks/mediqa_qa2019/README.md -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:39:33,793 copying lm_eval/tasks/webqs/README.md -> build/lib/lm_eval/tasks/webqs 2026-09-01T00:39:33,797 copying lm_eval/tasks/gsm_plus/README.md -> build/lib/lm_eval/tasks/gsm_plus 2026-09-01T00:39:33,799 copying lm_eval/tasks/logiqa2/README.md -> build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:39:33,803 copying lm_eval/tasks/afrobench/README.md -> build/lib/lm_eval/tasks/afrobench 2026-09-01T00:39:33,805 copying lm_eval/tasks/afrobench/adr/README.md -> build/lib/lm_eval/tasks/afrobench/adr 2026-09-01T00:39:33,809 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:39:33,811 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:39:33,813 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:39:33,816 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:39:33,818 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:39:33,821 copying lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:39:33,824 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:39:33,827 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:39:33,830 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:39:33,833 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:39:33,837 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:39:33,840 copying lm_eval/tasks/afrobench/salt/README.md -> build/lib/lm_eval/tasks/afrobench/salt 2026-09-01T00:39:33,843 copying lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:39:33,846 copying lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:39:33,848 copying lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:39:33,851 copying lm_eval/tasks/afrobench/belebele/README.md -> build/lib/lm_eval/tasks/afrobench/belebele 2026-09-01T00:39:33,854 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:39:33,856 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:39:33,859 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:39:33,861 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:39:33,864 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:39:33,866 copying lm_eval/tasks/afrobench/masakhapos/README.md -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:39:33,871 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:39:33,874 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:39:33,877 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:39:33,880 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:39:33,884 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:39:33,886 copying lm_eval/tasks/afrobench/injongointent/README.md -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:39:33,889 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:39:33,892 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:39:33,895 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:39:33,898 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:39:33,902 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:39:33,905 creating build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:39:33,906 copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:39:33,908 copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:39:33,911 copying lm_eval/tasks/afrobench/masakhanews/README.md -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:39:33,914 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:39:33,918 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:39:33,921 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:39:33,924 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:39:33,927 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:39:33,930 copying lm_eval/tasks/afrobench/afriqa/README.md -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:39:33,933 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:39:33,936 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:39:33,940 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:39:33,944 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:39:33,947 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:39:33,951 copying lm_eval/tasks/afrobench/mafand/README.md -> build/lib/lm_eval/tasks/afrobench/mafand 2026-09-01T00:39:33,954 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:39:33,958 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:39:33,961 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:39:33,965 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:39:33,968 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:39:33,971 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:39:33,975 copying lm_eval/tasks/afrobench/afrisenti/README.md -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:39:33,978 copying lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:39:33,981 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:33,984 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:39:33,987 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:39:33,991 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:39:33,995 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:39:33,999 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:34,002 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:39:34,006 copying lm_eval/tasks/afrobench/ntrex/README.md -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:39:34,010 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:39:34,012 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:39:34,015 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:39:34,018 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:39:34,021 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:39:34,023 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:39:34,026 copying lm_eval/tasks/afrobench/nollysenti/README.md -> build/lib/lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:39:34,029 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:39:34,033 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:39:34,036 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:39:34,039 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:39:34,043 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:39:34,045 copying lm_eval/tasks/afrobench/flores/README.md -> build/lib/lm_eval/tasks/afrobench/flores 2026-09-01T00:39:34,049 copying lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1 2026-09-01T00:39:34,052 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:39:34,054 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:39:34,057 copying lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3 2026-09-01T00:39:34,060 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:39:34,063 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:39:34,066 copying lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2 2026-09-01T00:39:34,068 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:39:34,070 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:39:34,072 copying lm_eval/tasks/afrobench/naijarc/README.md -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:39:34,075 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:39:34,078 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:39:34,080 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:39:34,083 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:39:34,085 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:39:34,088 copying lm_eval/tasks/afrobench/masakhaner/README.md -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:39:34,092 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:39:34,096 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:39:34,099 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:39:34,103 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:39:34,106 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:39:34,109 copying lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:39:34,112 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:39:34,115 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:39:34,117 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:39:34,120 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:39:34,122 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:39:34,125 copying lm_eval/tasks/afrobench/xlsum/README.md -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:39:34,128 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:39:34,132 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:39:34,135 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:39:34,137 copying lm_eval/tasks/afrobench/sib/README.md -> build/lib/lm_eval/tasks/afrobench/sib 2026-09-01T00:39:34,141 copying lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:39:34,144 copying lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:39:34,148 copying lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:39:34,151 copying lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:39:34,154 copying lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:39:34,157 copying lm_eval/tasks/mmlusr/README.md -> build/lib/lm_eval/tasks/mmlusr 2026-09-01T00:39:34,160 copying lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:39:34,164 copying lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:39:34,166 copying lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:39:34,171 copying lm_eval/tasks/ifeval/README.md -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:39:34,181 copying lm_eval/tasks/darija_bench/README.md -> build/lib/lm_eval/tasks/darija_bench 2026-09-01T00:39:34,184 copying lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:39:34,186 copying lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:39:34,190 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:39:34,192 copying lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:39:34,195 copying lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:39:34,198 copying lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:39:34,201 copying lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:34,203 copying lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:34,205 copying lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:34,208 copying lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:34,210 copying lm_eval/tasks/darija_bench/darija_translation/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:34,213 copying lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:39:34,216 copying lm_eval/tasks/humaneval_infilling/README.md -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:39:34,219 copying lm_eval/tasks/unitxt/README.md -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:34,221 copying lm_eval/tasks/unitxt/unitxt_multimodal -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:34,224 copying lm_eval/tasks/unitxt/unitxt -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:39:34,227 copying lm_eval/tasks/turkishmmlu/README.md -> build/lib/lm_eval/tasks/turkishmmlu 2026-09-01T00:39:34,230 copying lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:39:34,233 copying lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:39:34,235 copying lm_eval/tasks/llama3/README.md -> build/lib/lm_eval/tasks/llama3 2026-09-01T00:39:34,238 copying lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:39:34,242 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:39:34,245 copying lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:39:34,248 copying lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:39:34,251 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:39:34,255 copying lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:39:34,258 copying lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:39:34,260 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:39:34,263 copying lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:39:34,266 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:39:34,270 copying lm_eval/tasks/mutual/README.md -> build/lib/lm_eval/tasks/mutual 2026-09-01T00:39:34,273 copying lm_eval/tasks/aradice/README.md -> build/lib/lm_eval/tasks/aradice 2026-09-01T00:39:34,287 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:39:34,291 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:39:34,295 copying lm_eval/tasks/eus_proficiency/README.md -> build/lib/lm_eval/tasks/eus_proficiency 2026-09-01T00:39:34,298 copying lm_eval/tasks/bbq/README.md -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:39:34,301 copying lm_eval/tasks/tydiqa/_tydiqa_goldp_common_yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:34,303 copying lm_eval/tasks/tydiqa/README.md -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:39:34,307 copying lm_eval/tasks/mmlu/README.md -> build/lib/lm_eval/tasks/mmlu 2026-09-01T00:39:34,310 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:39:34,313 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:39:34,317 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:39:34,319 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:34,322 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:39:34,333 copying lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:39:34,337 copying lm_eval/tasks/mmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:39:34,341 copying lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:39:34,344 copying lm_eval/tasks/wikitext/README.md -> build/lib/lm_eval/tasks/wikitext 2026-09-01T00:39:34,347 copying lm_eval/tasks/pile_10k/README.md -> build/lib/lm_eval/tasks/pile_10k 2026-09-01T00:39:34,351 copying lm_eval/tasks/medtext/README.md -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:39:34,354 copying lm_eval/tasks/noticia/README.md -> build/lib/lm_eval/tasks/noticia 2026-09-01T00:39:34,358 copying lm_eval/tasks/olaph/README.md -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:39:34,361 copying lm_eval/tasks/race/README.md -> build/lib/lm_eval/tasks/race 2026-09-01T00:39:34,365 copying lm_eval/tasks/metabench/README.md -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:39:34,369 copying lm_eval/tasks/xwinograd/README.md -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:34,372 copying lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:39:34,374 copying lm_eval/tasks/lambada_multilingual/README.md -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:39:34,377 copying lm_eval/tasks/anli/README.md -> build/lib/lm_eval/tasks/anli 2026-09-01T00:39:34,380 copying lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:34,382 copying lm_eval/tasks/arab_culture_completion/README.md -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:39:34,387 copying lm_eval/tasks/paloma/_paloma_template -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:34,390 copying lm_eval/tasks/paloma/README.md -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:39:34,393 copying lm_eval/tasks/graphwalks/README.md -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:39:34,396 copying lm_eval/tasks/prost/README.md -> build/lib/lm_eval/tasks/prost 2026-09-01T00:39:34,399 copying lm_eval/tasks/moral_stories/README.md -> build/lib/lm_eval/tasks/moral_stories 2026-09-01T00:39:34,402 copying lm_eval/tasks/sciq/README.md -> build/lib/lm_eval/tasks/sciq 2026-09-01T00:39:34,405 copying lm_eval/tasks/swag/README.md -> build/lib/lm_eval/tasks/swag 2026-09-01T00:39:34,408 copying lm_eval/tasks/putnam_axiom/README.md -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:39:34,411 copying lm_eval/tasks/arc/README.md -> build/lib/lm_eval/tasks/arc 2026-09-01T00:39:34,414 copying lm_eval/tasks/glue/README.md -> build/lib/lm_eval/tasks/glue 2026-09-01T00:39:34,418 copying lm_eval/tasks/qasper/README.md -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:39:34,422 copying lm_eval/tasks/hellaswag/README.md -> build/lib/lm_eval/tasks/hellaswag 2026-09-01T00:39:34,425 copying lm_eval/tasks/esbbq/_esbbq_common_yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:34,428 copying lm_eval/tasks/esbbq/README.md -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:39:34,432 copying lm_eval/tasks/jfinqa/README.md -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:39:34,437 copying lm_eval/tasks/bigbench/generate_until_template_yaml -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:39:34,440 copying lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:39:34,444 copying lm_eval/tasks/bigbench/README.md -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:39:34,448 copying lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:39:34,452 copying lm_eval/tasks/e2lmc/noor/_noor_template -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:34,455 copying lm_eval/tasks/e2lmc/noor/README.md -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:39:34,460 copying lm_eval/tasks/e2lmc/mmlu_early_training/README.md -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:39:34,463 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:39:34,466 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:39:34,469 copying lm_eval/tasks/xnli_eu/README.md -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:39:34,472 copying lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:39:34,476 copying lm_eval/tasks/leaderboard/README.md -> build/lib/lm_eval/tasks/leaderboard 2026-09-01T00:39:34,479 copying lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:39:34,483 copying lm_eval/tasks/leaderboard/math/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:39:34,491 copying lm_eval/tasks/leaderboard/musr/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:39:34,496 copying lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:39:34,500 copying lm_eval/tasks/blimp/_template_yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:34,503 copying lm_eval/tasks/blimp/README.md -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:39:34,506 copying lm_eval/tasks/nerel-bench/_template_yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:39:34,509 copying lm_eval/tasks/nerel-bench/README.md -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:39:34,513 copying lm_eval/tasks/minerva_math/README.md -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:39:34,517 copying lm_eval/tasks/unscramble/README.md -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:39:34,520 copying lm_eval/tasks/squadv2/README.md -> build/lib/lm_eval/tasks/squadv2 2026-09-01T00:39:34,524 copying lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:34,527 copying lm_eval/tasks/mmlu_pro/README.md -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:39:34,531 copying lm_eval/tasks/multiblimp/_template_yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:34,533 copying lm_eval/tasks/multiblimp/README.md -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:39:34,537 copying lm_eval/tasks/polemo2/README.md -> build/lib/lm_eval/tasks/polemo2 2026-09-01T00:39:34,540 copying lm_eval/tasks/kbl/README.md -> build/lib/lm_eval/tasks/kbl 2026-09-01T00:39:34,543 copying lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:39:34,545 copying lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:39:34,548 copying lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:39:34,550 copying lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:39:34,552 copying lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:39:34,555 copying lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:39:34,557 copying lm_eval/tasks/libra/_template_yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:34,560 copying lm_eval/tasks/libra/README.md -> build/lib/lm_eval/tasks/libra 2026-09-01T00:39:34,563 copying lm_eval/tasks/winogrande/README.md -> build/lib/lm_eval/tasks/winogrande 2026-09-01T00:39:34,566 copying lm_eval/tasks/mc_taco/README.md -> build/lib/lm_eval/tasks/mc_taco 2026-09-01T00:39:34,569 copying lm_eval/tasks/arithmetic/README.md -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:39:34,572 copying lm_eval/tasks/bangla/README.md -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:39:44,116 installing to build/bdist.linux-armv7l/wheel 2026-09-01T00:39:44,117 running install 2026-09-01T00:39:44,140 running install_lib 2026-09-01T00:39:44,146 creating build/bdist.linux-armv7l/wheel 2026-09-01T00:39:44,148 creating build/bdist.linux-armv7l/wheel/lm_eval 2026-09-01T00:39:44,150 creating build/bdist.linux-armv7l/wheel/lm_eval/caching 2026-09-01T00:39:44,151 copying build/lib/lm_eval/caching/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2026-09-01T00:39:44,153 copying build/lib/lm_eval/caching/cache.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2026-09-01T00:39:44,156 creating build/bdist.linux-armv7l/wheel/lm_eval/filters 2026-09-01T00:39:44,157 copying build/lib/lm_eval/filters/selection.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:39:44,159 copying build/lib/lm_eval/filters/custom.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:39:44,161 copying build/lib/lm_eval/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:39:44,163 copying build/lib/lm_eval/filters/extraction.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:39:44,165 copying build/lib/lm_eval/filters/transformation.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:39:44,167 copying build/lib/lm_eval/filters/decontamination.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:39:44,169 copying build/lib/lm_eval/evaluator.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:39:44,173 creating build/bdist.linux-armv7l/wheel/lm_eval/config 2026-09-01T00:39:44,174 copying build/lib/lm_eval/config/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-09-01T00:39:44,176 copying build/lib/lm_eval/config/evaluate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-09-01T00:39:44,179 copying build/lib/lm_eval/config/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-09-01T00:39:44,181 copying build/lib/lm_eval/config/group.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-09-01T00:39:44,185 creating build/bdist.linux-armv7l/wheel/lm_eval/models 2026-09-01T00:39:44,186 copying build/lib/lm_eval/models/textsynth.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,188 copying build/lib/lm_eval/models/trtllm_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,191 copying build/lib/lm_eval/models/nemo_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,194 copying build/lib/lm_eval/models/hf_audiolm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,196 copying build/lib/lm_eval/models/gguf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,199 copying build/lib/lm_eval/models/onnxruntime_genai.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,201 copying build/lib/lm_eval/models/optimum_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,203 copying build/lib/lm_eval/models/api_models.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,206 copying build/lib/lm_eval/models/onnxruntime_ort.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,209 copying build/lib/lm_eval/models/litellm_llms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,211 copying build/lib/lm_eval/models/vllm_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,214 copying build/lib/lm_eval/models/hf_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,216 copying build/lib/lm_eval/models/megatron_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,220 copying build/lib/lm_eval/models/sglang_generate_API.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,222 copying build/lib/lm_eval/models/mamba_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,224 copying build/lib/lm_eval/models/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,226 copying build/lib/lm_eval/models/mistral3.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,228 copying build/lib/lm_eval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,231 copying build/lib/lm_eval/models/sglang_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,234 copying build/lib/lm_eval/models/optimum_ipex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,236 copying build/lib/lm_eval/models/utils_hf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,238 copying build/lib/lm_eval/models/anthropic_llms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,240 copying build/lib/lm_eval/models/neuron_optimum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,243 copying build/lib/lm_eval/models/winml.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,245 copying build/lib/lm_eval/models/vllm_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,248 copying build/lib/lm_eval/models/_onnx_base.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,250 copying build/lib/lm_eval/models/openai_completions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,253 copying build/lib/lm_eval/models/optimum_habana.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,255 copying build/lib/lm_eval/models/huggingface.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,259 copying build/lib/lm_eval/models/dummy.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,261 copying build/lib/lm_eval/models/hf_steered.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,263 copying build/lib/lm_eval/models/ibm_watsonx_ai.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:39:44,266 creating build/bdist.linux-armv7l/wheel/lm_eval/prompts 2026-09-01T00:39:44,267 copying build/lib/lm_eval/prompts/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/prompts 2026-09-01T00:39:44,270 creating build/bdist.linux-armv7l/wheel/lm_eval/loggers 2026-09-01T00:39:44,272 copying build/lib/lm_eval/loggers/trackio_logger.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:39:44,274 copying build/lib/lm_eval/loggers/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:39:44,276 copying build/lib/lm_eval/loggers/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:39:44,278 copying build/lib/lm_eval/loggers/wandb_logger.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:39:44,281 copying build/lib/lm_eval/loggers/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:39:44,284 copying build/lib/lm_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:39:44,286 copying build/lib/lm_eval/evaluator_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:39:44,293 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks 2026-09-01T00:39:44,295 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,296 copying build/lib/lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,298 copying build/lib/lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,300 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,302 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,304 copying build/lib/lm_eval/tasks/hendrycks_ethics/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,306 copying build/lib/lm_eval/tasks/hendrycks_ethics/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,308 copying build/lib/lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,310 copying build/lib/lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:39:44,312 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench 2026-09-01T00:39:44,314 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,315 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,318 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,320 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,324 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,326 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,328 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,330 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,333 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,335 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,337 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,340 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:39:44,343 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,344 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,346 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,348 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,350 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,352 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,354 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,356 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,358 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:39:44,360 copying build/lib/lm_eval/tasks/acpbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench 2026-09-01T00:39:44,363 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,364 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,367 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,369 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,372 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,374 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,376 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,378 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,380 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,381 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,384 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,386 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:39:44,389 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,390 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,392 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,394 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,396 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,398 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,400 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,402 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,405 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:39:44,407 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mbpp 2026-09-01T00:39:44,408 copying build/lib/lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:39:44,410 copying build/lib/lm_eval/tasks/mbpp/mbpp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:39:44,412 copying build/lib/lm_eval/tasks/mbpp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:39:44,414 copying build/lib/lm_eval/tasks/mbpp/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:39:44,416 copying build/lib/lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:39:44,418 copying build/lib/lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:39:44,421 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa 2026-09-01T00:39:44,422 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:39:44,424 copying build/lib/lm_eval/tasks/truthfulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:39:44,426 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:39:44,428 copying build/lib/lm_eval/tasks/truthfulqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:39:44,431 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:39:44,433 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/siqa 2026-09-01T00:39:44,434 copying build/lib/lm_eval/tasks/siqa/siqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2026-09-01T00:39:44,436 copying build/lib/lm_eval/tasks/siqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2026-09-01T00:39:44,439 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/c4 2026-09-01T00:39:44,440 copying build/lib/lm_eval/tasks/c4/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-09-01T00:39:44,442 copying build/lib/lm_eval/tasks/c4/preprocess_c4.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-09-01T00:39:44,444 copying build/lib/lm_eval/tasks/c4/c4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-09-01T00:39:44,446 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux 2026-09-01T00:39:44,449 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,450 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,452 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,454 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,455 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,457 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,459 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,461 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,462 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,464 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,466 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,468 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,470 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,472 copying build/lib/lm_eval/tasks/mmlu-redux/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,473 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,475 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,477 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,478 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,480 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,482 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,483 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,485 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,487 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,489 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,490 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,492 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,494 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,495 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,497 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,499 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,501 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,502 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,504 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,506 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,507 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,509 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,511 copying build/lib/lm_eval/tasks/mmlu-redux/generative/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,513 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,515 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,516 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,518 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,520 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,521 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,523 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,525 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,526 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,528 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,530 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,531 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,533 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,535 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,537 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,538 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,540 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,542 copying build/lib/lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,544 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,545 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,547 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,549 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,551 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,552 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:39:44,555 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:39:44,556 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:39:44,558 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:39:44,559 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:39:44,561 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:39:44,563 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:39:44,564 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:39:44,566 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:39:44,568 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:39:44,570 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:39:44,571 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:39:44,573 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:39:44,575 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:39:44,577 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:39:44,578 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:39:44,580 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:39:44,582 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:39:44,585 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,586 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,588 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,590 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,591 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,593 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,595 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,597 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,599 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,601 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,603 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,605 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:39:44,607 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:39:44,608 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:39:44,610 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:39:44,612 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:39:44,615 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:39:44,616 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:39:44,618 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:39:44,619 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:39:44,623 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,624 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,625 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,627 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,629 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,631 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,632 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,634 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,636 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,638 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,640 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,641 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,643 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,645 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,647 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,649 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,650 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,652 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,654 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,655 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,657 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,659 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,661 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,663 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,665 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,666 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,669 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,671 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,673 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,675 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,677 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,679 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,681 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,682 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,684 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,686 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,688 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,690 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,692 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,693 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,695 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,697 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,699 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,701 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,703 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,705 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,706 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,708 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,710 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,712 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,713 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,715 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,717 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,719 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,721 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,723 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,725 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,726 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,728 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,730 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:39:44,732 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:39:44,733 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:39:44,735 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:39:44,737 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:39:44,740 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,741 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,743 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,744 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,746 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,748 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,750 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,752 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,754 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,756 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,758 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,759 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,761 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,763 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,764 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,766 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,768 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,770 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,772 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,773 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,775 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,777 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,779 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,781 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,783 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,785 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,787 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,789 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,790 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,792 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,794 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,796 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,798 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,800 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,802 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,803 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,805 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,807 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,809 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,811 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,813 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,815 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,817 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,818 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,820 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,822 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,824 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,825 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,827 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,829 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,831 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,832 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,834 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,836 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,838 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,840 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,841 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,843 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,845 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,847 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,849 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:39:44,850 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:39:44,853 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:39:44,854 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:39:44,857 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:39:44,859 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:39:44,861 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:39:44,862 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:39:44,864 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:39:44,866 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:39:44,868 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:39:44,870 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:39:44,871 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:39:44,873 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:39:44,875 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:39:44,878 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:39:44,879 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:39:44,881 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:39:44,883 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:39:44,885 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:39:44,886 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:39:44,888 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:39:44,889 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:39:44,893 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,894 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,896 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,898 copying build/lib/lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,900 copying build/lib/lm_eval/tasks/blimp_nl/r_words__adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,902 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,904 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,906 copying build/lib/lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,908 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,910 copying build/lib/lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,912 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,914 copying build/lib/lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,916 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,917 copying build/lib/lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,919 copying build/lib/lm_eval/tasks/blimp_nl/passive__impersonal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,921 copying build/lib/lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,922 copying build/lib/lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,924 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,926 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,928 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,929 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,931 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,933 copying build/lib/lm_eval/tasks/blimp_nl/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,935 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,936 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,938 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,940 copying build/lib/lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,942 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,943 copying build/lib/lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,945 copying build/lib/lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,947 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,949 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,951 copying build/lib/lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,953 copying build/lib/lm_eval/tasks/blimp_nl/complementive__position_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,955 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,956 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,958 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,960 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,962 copying build/lib/lm_eval/tasks/blimp_nl/complementive__transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,964 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,966 copying build/lib/lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,968 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,969 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,971 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,973 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,975 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,977 copying build/lib/lm_eval/tasks/blimp_nl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,979 copying build/lib/lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,981 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,982 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,984 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,986 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,988 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,990 copying build/lib/lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,992 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,993 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,995 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,997 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:44,999 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,001 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,003 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,005 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,007 copying build/lib/lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,008 copying build/lib/lm_eval/tasks/blimp_nl/passive__aci.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,010 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,012 copying build/lib/lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,014 copying build/lib/lm_eval/tasks/blimp_nl/relativization__island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,016 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,017 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,019 copying build/lib/lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,021 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,023 copying build/lib/lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,025 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,026 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,028 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,030 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,032 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,034 copying build/lib/lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,036 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,038 copying build/lib/lm_eval/tasks/blimp_nl/verb_second__order_main.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,040 copying build/lib/lm_eval/tasks/blimp_nl/complementive__intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,041 copying build/lib/lm_eval/tasks/blimp_nl/blimp_nl_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,044 copying build/lib/lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,046 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,048 copying build/lib/lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,050 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,052 copying build/lib/lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,054 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:39:45,056 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ulqa 2026-09-01T00:39:45,058 copying build/lib/lm_eval/tasks/ulqa/lambada_uyghur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:39:45,060 copying build/lib/lm_eval/tasks/ulqa/celep1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:39:45,062 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:45,063 copying build/lib/lm_eval/tasks/ulqa/ulut/wag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:45,065 copying build/lib/lm_eval/tasks/ulqa/ulut/nug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:45,067 copying build/lib/lm_eval/tasks/ulqa/ulut/ulut.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:45,069 copying build/lib/lm_eval/tasks/ulqa/ulut/wub.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:45,071 copying build/lib/lm_eval/tasks/ulqa/ulut/wum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:45,073 copying build/lib/lm_eval/tasks/ulqa/ulut/wsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:39:45,075 copying build/lib/lm_eval/tasks/ulqa/ulqa_.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:39:45,076 copying build/lib/lm_eval/tasks/ulqa/uleval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:39:45,078 copying build/lib/lm_eval/tasks/ulqa/celep2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:39:45,080 copying build/lib/lm_eval/tasks/ulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:39:45,082 copying build/lib/lm_eval/tasks/ulqa/ulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:39:45,085 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lingoly 2026-09-01T00:39:45,086 copying build/lib/lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:39:45,088 copying build/lib/lm_eval/tasks/lingoly/lingoly_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:39:45,090 copying build/lib/lm_eval/tasks/lingoly/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:39:45,092 copying build/lib/lm_eval/tasks/lingoly/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:39:45,094 copying build/lib/lm_eval/tasks/lingoly/script.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:39:45,096 copying build/lib/lm_eval/tasks/lingoly/lingoly_context.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:39:45,099 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,100 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,102 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,104 copying build/lib/lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,106 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,108 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,110 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,112 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,114 copying build/lib/lm_eval/tasks/mmlu-pro-plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,116 copying build/lib/lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,118 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,120 copying build/lib/lm_eval/tasks/mmlu-pro-plus/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,122 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,123 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,125 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,127 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,129 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,131 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,132 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:39:45,135 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mimic_repsum 2026-09-01T00:39:45,136 copying build/lib/lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:39:45,138 copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:39:45,140 copying build/lib/lm_eval/tasks/mimic_repsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:39:45,142 copying build/lib/lm_eval/tasks/mimic_repsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:39:45,144 copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:39:45,148 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egymmlu 2026-09-01T00:39:45,149 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,151 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,153 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,155 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,157 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,159 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,161 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,163 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,165 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,167 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,169 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,171 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,172 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,174 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,176 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,178 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,180 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,182 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,184 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,185 copying build/lib/lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,187 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,189 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,191 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,193 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,195 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,197 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,199 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,201 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,203 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,205 copying build/lib/lm_eval/tasks/egymmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,207 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,208 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,210 copying build/lib/lm_eval/tasks/egymmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,212 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,214 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,216 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,218 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,220 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,222 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,224 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,226 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,228 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,230 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,231 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,233 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,235 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,237 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,239 copying build/lib/lm_eval/tasks/egymmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,241 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,243 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,245 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:39:45,247 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aime 2026-09-01T00:39:45,248 copying build/lib/lm_eval/tasks/aime/aime25.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:39:45,250 copying build/lib/lm_eval/tasks/aime/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:39:45,252 copying build/lib/lm_eval/tasks/aime/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:39:45,254 copying build/lib/lm_eval/tasks/aime/aime24.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:39:45,256 copying build/lib/lm_eval/tasks/aime/aime.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:39:45,259 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:39:45,260 copying build/lib/lm_eval/tasks/icelandic_winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-09-01T00:39:45,262 copying build/lib/lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-09-01T00:39:45,264 copying build/lib/lm_eval/tasks/icelandic_winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-09-01T00:39:45,267 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmt2016 2026-09-01T00:39:45,268 copying build/lib/lm_eval/tasks/wmt2016/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-09-01T00:39:45,270 copying build/lib/lm_eval/tasks/wmt2016/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-09-01T00:39:45,272 copying build/lib/lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-09-01T00:39:45,275 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xcopa 2026-09-01T00:39:45,276 copying build/lib/lm_eval/tasks/xcopa/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,278 copying build/lib/lm_eval/tasks/xcopa/default_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,280 copying build/lib/lm_eval/tasks/xcopa/default_et.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,282 copying build/lib/lm_eval/tasks/xcopa/default_ht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,283 copying build/lib/lm_eval/tasks/xcopa/default_qu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,285 copying build/lib/lm_eval/tasks/xcopa/default_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,287 copying build/lib/lm_eval/tasks/xcopa/default_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,289 copying build/lib/lm_eval/tasks/xcopa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,291 copying build/lib/lm_eval/tasks/xcopa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,293 copying build/lib/lm_eval/tasks/xcopa/_xcopa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,295 copying build/lib/lm_eval/tasks/xcopa/default_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,297 copying build/lib/lm_eval/tasks/xcopa/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,299 copying build/lib/lm_eval/tasks/xcopa/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,301 copying build/lib/lm_eval/tasks/xcopa/default_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:39:45,304 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_exams 2026-09-01T00:39:45,306 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,308 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,310 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,311 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,313 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,315 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,317 copying build/lib/lm_eval/tasks/eus_exams/eus_exams -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,319 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,321 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,323 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,325 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,327 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,329 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,331 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,333 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,335 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,337 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,338 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,340 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,342 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,344 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,346 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,348 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,350 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,352 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,354 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,356 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,358 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,359 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,361 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,363 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,365 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,367 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,369 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,371 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,373 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,375 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,377 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,379 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,381 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,383 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,385 copying build/lib/lm_eval/tasks/eus_exams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,387 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,388 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,390 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,392 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,394 copying build/lib/lm_eval/tasks/eus_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,396 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,398 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,399 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,401 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,403 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,405 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,407 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,409 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,411 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,412 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,414 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,416 copying build/lib/lm_eval/tasks/eus_exams/configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,418 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,420 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,422 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,424 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,426 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,428 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,429 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,431 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,433 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:39:45,436 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cruxeval 2026-09-01T00:39:45,437 copying build/lib/lm_eval/tasks/cruxeval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,439 copying build/lib/lm_eval/tasks/cruxeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,441 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_input_08.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,443 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,445 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_output.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,447 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_input.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,449 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_output_08.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,450 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_input_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,452 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_output_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:39:45,455 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/translation 2026-09-01T00:39:45,456 copying build/lib/lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,458 copying build/lib/lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,460 copying build/lib/lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,462 copying build/lib/lm_eval/tasks/translation/wmt16_de-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,464 copying build/lib/lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,466 copying build/lib/lm_eval/tasks/translation/wmt16_en-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,468 copying build/lib/lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,470 copying build/lib/lm_eval/tasks/translation/wmt_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,472 copying build/lib/lm_eval/tasks/translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,474 copying build/lib/lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,476 copying build/lib/lm_eval/tasks/translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:39:45,480 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench 2026-09-01T00:39:45,481 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,483 copying build/lib/lm_eval/tasks/galician_bench/galician_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,485 copying build/lib/lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,487 copying build/lib/lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,489 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,490 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,492 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,494 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,496 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,498 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,500 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,502 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,504 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,505 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,507 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,510 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,512 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,514 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,515 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,517 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,519 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,521 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,523 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,525 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:39:45,527 copying build/lib/lm_eval/tasks/galician_bench/galcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,530 copying build/lib/lm_eval/tasks/galician_bench/paws_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,532 copying build/lib/lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,534 copying build/lib/lm_eval/tasks/galician_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,536 copying build/lib/lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,538 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,539 copying build/lib/lm_eval/tasks/galician_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,542 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,543 copying build/lib/lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,545 copying build/lib/lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,547 copying build/lib/lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:39:45,550 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,551 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_history_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,553 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,555 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_driving_rules.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,556 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,558 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_history_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,560 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_agriculture_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,562 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,563 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_economics_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,565 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,567 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,569 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,571 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_management_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,573 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_maritime_safety_and_rescue_operations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,574 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,576 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_physics_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,578 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,580 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_management_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,582 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_history_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,584 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_traditions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,586 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_education_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,588 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_geography_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,589 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_geography_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,591 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,593 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_art_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,595 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,597 copying build/lib/lm_eval/tasks/greekmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,599 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_computer_networks_and_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,601 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_medicine_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,602 copying build/lib/lm_eval/tasks/greekmmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,604 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_physics_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,606 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_agriculture_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,608 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_computer_science_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,610 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_mythology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,612 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,614 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,616 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_medicine_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,618 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,620 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,622 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_art_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,624 copying build/lib/lm_eval/tasks/greekmmlu/_default_greekmmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,626 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,628 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,630 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,632 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_physics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,634 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,636 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,637 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_education_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,639 copying build/lib/lm_eval/tasks/greekmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,642 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,643 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,645 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_economics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,647 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_art_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,649 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,651 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_computer_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:39:45,654 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openai-mmmlu 2026-09-01T00:39:45,655 copying build/lib/lm_eval/tasks/openai-mmmlu/languages.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-09-01T00:39:45,657 copying build/lib/lm_eval/tasks/openai-mmmlu/subjects.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-09-01T00:39:45,659 copying build/lib/lm_eval/tasks/openai-mmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-09-01T00:39:45,661 copying build/lib/lm_eval/tasks/openai-mmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-09-01T00:39:45,677 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,678 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,680 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,682 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,684 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,686 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,688 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,690 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,692 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,694 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,696 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,698 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,700 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,702 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,704 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,705 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,707 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,709 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,711 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,713 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,715 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,717 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,719 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,721 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,723 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,725 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,727 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,729 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,730 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,732 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,734 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,737 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,739 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,740 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,742 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,744 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,746 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,748 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,750 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,752 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,753 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,755 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,757 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,759 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,760 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,762 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,764 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,768 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,770 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,772 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,774 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,776 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,778 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,780 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,782 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,784 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,786 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,788 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,790 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,792 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,794 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,796 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,798 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,799 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,801 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,803 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,805 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,807 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,809 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,811 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,813 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,815 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,817 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,819 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,821 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,823 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,825 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,827 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,829 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,831 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,833 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,835 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,837 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,839 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,841 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,843 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,844 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,846 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,848 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,850 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,852 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,854 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,856 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,858 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,860 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,862 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,864 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,866 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,868 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,870 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,871 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,873 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,876 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,878 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,880 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,882 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,883 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,885 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,887 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,889 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,891 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,893 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,895 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,897 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,899 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,901 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,903 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,905 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,907 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,909 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,911 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,913 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,914 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,916 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,918 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,920 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,922 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,924 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,926 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,927 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,929 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,931 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,933 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,935 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,937 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,939 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,941 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,943 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,945 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,947 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,949 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,951 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,953 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,955 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,957 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,959 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,961 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,963 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,964 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,966 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,968 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,970 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,972 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,974 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,976 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,978 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,980 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,982 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,984 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,986 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,988 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,990 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,992 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,994 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,996 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:45,998 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,000 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,002 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,004 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,006 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,008 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,010 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,012 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,014 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,016 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,018 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,020 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,022 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,024 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,026 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,028 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,030 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,032 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,034 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,036 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,037 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,039 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,042 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,043 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,045 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,047 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,049 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,051 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,054 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,056 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,058 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,060 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,062 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,063 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,065 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,067 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,069 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,071 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,073 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,075 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,077 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,079 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,081 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,083 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,085 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,087 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,089 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,091 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,093 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,095 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,097 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,099 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,101 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,103 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,105 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,107 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,109 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,110 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,112 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,114 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,116 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,118 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,120 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,122 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,124 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,126 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,129 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,130 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,132 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,134 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,136 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,138 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,140 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,142 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,144 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,146 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,148 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,149 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,151 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,153 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,155 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,157 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,159 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,161 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,163 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,165 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,167 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,169 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,171 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,173 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,175 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,177 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,179 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,181 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,183 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,185 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,186 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,188 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,190 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,192 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,194 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,196 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,198 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,200 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,202 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,204 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,206 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,208 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,210 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,212 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,214 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,216 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,218 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,220 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,222 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,224 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,226 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,227 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,229 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,231 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,233 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,235 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,237 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,239 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,241 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,243 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,245 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,247 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,249 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,251 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,253 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,255 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,257 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,259 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,261 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,263 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,265 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,266 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,268 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,270 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,272 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,274 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,276 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,278 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,279 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,281 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,283 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,285 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,287 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,289 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,291 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,293 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,295 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,297 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,299 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,301 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,303 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,305 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,307 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,308 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,310 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,312 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,314 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,316 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,318 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,320 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,322 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,324 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,326 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,328 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,329 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,331 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,333 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,335 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,337 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,339 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,341 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,344 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,346 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,348 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,349 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,351 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,353 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,355 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,357 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,359 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,361 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,363 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,365 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,366 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,368 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,370 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,372 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,374 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,376 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,378 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,380 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,382 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,384 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,386 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,388 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,390 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,392 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,393 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,395 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,397 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,399 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,401 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,403 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,404 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,406 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,408 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,410 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,412 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,414 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,416 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,418 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,420 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,422 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,424 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,426 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,428 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,430 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,432 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,434 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,435 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,437 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,439 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,441 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,443 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,445 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,447 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,448 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,450 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,452 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,454 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,456 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,458 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,460 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,462 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,464 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,466 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,468 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,470 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,472 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,474 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,476 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,478 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,479 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,481 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,483 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,485 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,487 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,489 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,491 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,492 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,494 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,496 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,498 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,500 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,502 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,504 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,506 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,508 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,510 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,512 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,514 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,516 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,517 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,519 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,521 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,523 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,525 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,527 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,528 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,530 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,532 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,534 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,536 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,538 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,539 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,541 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,543 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,545 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,547 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,549 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,551 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,553 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,555 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,557 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,558 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,560 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,562 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,564 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,566 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,568 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,569 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,571 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,573 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,575 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,577 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,579 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,581 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,583 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,585 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,586 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,588 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,590 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,593 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,595 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,597 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,599 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,601 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,603 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,605 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,607 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,608 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,610 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,612 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,614 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,616 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,618 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,620 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,622 copying build/lib/lm_eval/tasks/openai-mmmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,624 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,625 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,627 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,629 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,631 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,633 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,635 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,637 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,639 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,642 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,643 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,645 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,647 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,649 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,651 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,653 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,654 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,656 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,658 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,660 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,662 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,664 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,666 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,668 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,670 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,672 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,673 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,676 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,677 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,680 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,681 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,684 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,685 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,687 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,689 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,691 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,693 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,695 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,697 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,699 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,701 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,703 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,705 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,707 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,709 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,711 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,713 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,714 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,716 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,718 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,720 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,722 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,724 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,727 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,729 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,730 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,732 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,734 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,736 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,738 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,740 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,742 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,743 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,745 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,747 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,749 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,751 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,753 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,755 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,757 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,758 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,760 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,762 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,764 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,766 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,768 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,770 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,772 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,774 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,776 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,777 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,779 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,781 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,783 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,785 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,787 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,789 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,791 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,793 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,795 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,797 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,799 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,801 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,803 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,805 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,807 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,809 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,811 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,813 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,815 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,817 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,818 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,820 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,822 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,824 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,827 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,829 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,831 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,833 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,835 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,837 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,839 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,841 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,843 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,846 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,848 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,850 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,852 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,854 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,856 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,858 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,860 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,862 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,864 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,866 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,868 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,870 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,872 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,874 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,876 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,878 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,881 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,883 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,885 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,887 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,889 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,891 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,893 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,895 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,897 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,900 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,902 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,904 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,906 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,908 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,910 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,912 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,914 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,917 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,919 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,921 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,923 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,925 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,927 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,929 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,931 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,934 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,936 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,938 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,940 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,942 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,944 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,947 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,949 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,951 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,953 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,955 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,957 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,959 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,961 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,963 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,965 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,967 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,969 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,971 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,973 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,975 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,977 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,979 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,981 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,983 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,986 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,988 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,990 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,992 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,994 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,996 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:46,998 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,001 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,002 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,005 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,007 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,009 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,011 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,013 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,015 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,017 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,019 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,021 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,023 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,025 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,027 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,029 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,031 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,033 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,035 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,037 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,039 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,041 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,044 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,046 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,048 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,050 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,052 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,054 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,056 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,058 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,060 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,062 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,064 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,066 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,068 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,070 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,072 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,074 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,077 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,079 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,081 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,083 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,085 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,087 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,089 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,092 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,094 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,096 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,098 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,100 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,102 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,104 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,106 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,108 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,110 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,112 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,114 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,116 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,118 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,121 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,123 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,125 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,127 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,129 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,131 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,133 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,135 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,138 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,139 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,141 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,143 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,145 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,147 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,149 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,151 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,153 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,155 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,157 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,159 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,161 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,163 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,165 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,167 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,169 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,172 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,174 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,176 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,178 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,180 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,182 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,184 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,186 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,188 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,190 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,192 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,194 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,196 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,198 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,200 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,202 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,204 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,206 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,208 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,210 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,212 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,214 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,216 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,218 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,221 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,223 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,225 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,227 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,229 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,231 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,233 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,235 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,237 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,239 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,241 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,243 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,245 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,247 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,250 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,252 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,254 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,256 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,259 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,261 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,263 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,265 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,267 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,269 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,271 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,274 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,276 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,278 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,280 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,282 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,283 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,285 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,287 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,290 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,292 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,294 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,296 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,298 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,301 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,303 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,305 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,307 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,309 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,311 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,313 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,316 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,318 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,320 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,322 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,324 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,326 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,328 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,330 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,332 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,334 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,336 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,338 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,340 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,342 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,344 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,346 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,348 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,350 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,353 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,355 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,357 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,359 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,361 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,363 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,365 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,368 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,370 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,372 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,373 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,375 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,377 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,379 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,381 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,383 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,385 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,387 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,389 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,392 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,393 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,396 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,398 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,400 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,402 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:39:47,405 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ruler 2026-09-01T00:39:47,406 copying build/lib/lm_eval/tasks/ruler/vt_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,409 copying build/lib/lm_eval/tasks/ruler/niah_single_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,410 copying build/lib/lm_eval/tasks/ruler/prepare_niah.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,413 copying build/lib/lm_eval/tasks/ruler/essays.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,416 copying build/lib/lm_eval/tasks/ruler/niah_multivalue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,418 copying build/lib/lm_eval/tasks/ruler/cwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,419 copying build/lib/lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,421 copying build/lib/lm_eval/tasks/ruler/vt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,423 copying build/lib/lm_eval/tasks/ruler/qa_squad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,425 copying build/lib/lm_eval/tasks/ruler/qa_hotpot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,427 copying build/lib/lm_eval/tasks/ruler/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,429 copying build/lib/lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,431 copying build/lib/lm_eval/tasks/ruler/fwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,432 copying build/lib/lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,434 copying build/lib/lm_eval/tasks/ruler/qa_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,437 copying build/lib/lm_eval/tasks/ruler/cwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,439 copying build/lib/lm_eval/tasks/ruler/niah_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,441 copying build/lib/lm_eval/tasks/ruler/niah_single_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,443 copying build/lib/lm_eval/tasks/ruler/niah_multiquery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,445 copying build/lib/lm_eval/tasks/ruler/ruler.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,447 copying build/lib/lm_eval/tasks/ruler/niah_single_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,449 copying build/lib/lm_eval/tasks/ruler/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,451 copying build/lib/lm_eval/tasks/ruler/fwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:39:47,454 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openbookqa 2026-09-01T00:39:47,456 copying build/lib/lm_eval/tasks/openbookqa/openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2026-09-01T00:39:47,458 copying build/lib/lm_eval/tasks/openbookqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2026-09-01T00:39:47,461 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turblimp 2026-09-01T00:39:47,462 copying build/lib/lm_eval/tasks/turblimp/island_effects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,464 copying build/lib/lm_eval/tasks/turblimp/binding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,466 copying build/lib/lm_eval/tasks/turblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,468 copying build/lib/lm_eval/tasks/turblimp/passives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,470 copying build/lib/lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,472 copying build/lib/lm_eval/tasks/turblimp/nominalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,474 copying build/lib/lm_eval/tasks/turblimp/npi_licensing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,476 copying build/lib/lm_eval/tasks/turblimp/subject_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,478 copying build/lib/lm_eval/tasks/turblimp/relative_clauses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,479 copying build/lib/lm_eval/tasks/turblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,481 copying build/lib/lm_eval/tasks/turblimp/scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,483 copying build/lib/lm_eval/tasks/turblimp/ellipsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,485 copying build/lib/lm_eval/tasks/turblimp/suspended_affixation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,487 copying build/lib/lm_eval/tasks/turblimp/anaphor_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,488 copying build/lib/lm_eval/tasks/turblimp/argument_structure_transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,490 copying build/lib/lm_eval/tasks/turblimp/quantifiers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,492 copying build/lib/lm_eval/tasks/turblimp/irregular_forms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,494 copying build/lib/lm_eval/tasks/turblimp/turblimp_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,496 copying build/lib/lm_eval/tasks/turblimp/determiners.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:39:47,498 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cabbq 2026-09-01T00:39:47,500 copying build/lib/lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,501 copying build/lib/lm_eval/tasks/cabbq/cabbq_disability_status.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,503 copying build/lib/lm_eval/tasks/cabbq/cabbq_ses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,505 copying build/lib/lm_eval/tasks/cabbq/cabbq_spanish_region.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,507 copying build/lib/lm_eval/tasks/cabbq/cabbq_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,509 copying build/lib/lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,511 copying build/lib/lm_eval/tasks/cabbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,513 copying build/lib/lm_eval/tasks/cabbq/cabbq_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,515 copying build/lib/lm_eval/tasks/cabbq/_cabbq_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,517 copying build/lib/lm_eval/tasks/cabbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,519 copying build/lib/lm_eval/tasks/cabbq/cabbq_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,521 copying build/lib/lm_eval/tasks/cabbq/cabbq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,523 copying build/lib/lm_eval/tasks/cabbq/cabbq_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,525 copying build/lib/lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:39:47,528 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu 2026-09-01T00:39:47,529 copying build/lib/lm_eval/tasks/tmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2026-09-01T00:39:47,531 copying build/lib/lm_eval/tasks/tmlu/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2026-09-01T00:39:47,534 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,535 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,537 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,539 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,541 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,543 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,545 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,547 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,549 copying build/lib/lm_eval/tasks/tmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,551 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,552 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,554 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,556 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,558 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,560 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,562 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,564 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,566 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,568 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,570 copying build/lib/lm_eval/tasks/tmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,572 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,574 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,576 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,578 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,579 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,581 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,584 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,585 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,587 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,589 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,591 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,593 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,595 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,597 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,599 copying build/lib/lm_eval/tasks/tmlu/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,601 copying build/lib/lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:39:47,603 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench 2026-09-01T00:39:47,604 copying build/lib/lm_eval/tasks/eq_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-09-01T00:39:47,607 copying build/lib/lm_eval/tasks/eq_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-09-01T00:39:47,609 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:39:47,610 copying build/lib/lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:39:47,612 copying build/lib/lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:39:47,614 copying build/lib/lm_eval/tasks/eq_bench/multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:39:47,616 copying build/lib/lm_eval/tasks/eq_bench/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-09-01T00:39:47,619 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,620 copying build/lib/lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,622 copying build/lib/lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,624 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,626 copying build/lib/lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,628 copying build/lib/lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,630 copying build/lib/lm_eval/tasks/catalan_bench/teca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,632 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,634 copying build/lib/lm_eval/tasks/catalan_bench/catcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,636 copying build/lib/lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,638 copying build/lib/lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,640 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,642 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,644 copying build/lib/lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,646 copying build/lib/lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,648 copying build/lib/lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,650 copying build/lib/lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,651 copying build/lib/lm_eval/tasks/catalan_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,654 copying build/lib/lm_eval/tasks/catalan_bench/coqcat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,656 copying build/lib/lm_eval/tasks/catalan_bench/xnli_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,658 copying build/lib/lm_eval/tasks/catalan_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,661 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:39:47,662 copying build/lib/lm_eval/tasks/catalan_bench/cieacova/cieacova.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:39:47,664 copying build/lib/lm_eval/tasks/catalan_bench/cieacova/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:39:47,666 copying build/lib/lm_eval/tasks/catalan_bench/cieacova/cieacova_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:39:47,668 copying build/lib/lm_eval/tasks/catalan_bench/cieacova/cieacova_word.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:39:47,671 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:39:47,672 copying build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:39:47,674 copying build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:39:47,677 copying build/lib/lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,679 copying build/lib/lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,681 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,683 copying build/lib/lm_eval/tasks/catalan_bench/terretaqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,684 copying build/lib/lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,687 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,688 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,691 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,693 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,695 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,697 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,699 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,701 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,703 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,705 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,707 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,709 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,711 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,713 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,715 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,717 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,719 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,721 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,723 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,725 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:39:47,727 copying build/lib/lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,729 copying build/lib/lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,732 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:39:47,733 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:39:47,735 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:39:47,737 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:39:47,739 copying build/lib/lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:39:47,743 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babilong 2026-09-01T00:39:47,744 copying build/lib/lm_eval/tasks/babilong/babilong.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,746 copying build/lib/lm_eval/tasks/babilong/babilong_qa11.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,748 copying build/lib/lm_eval/tasks/babilong/babilong_qa7.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,750 copying build/lib/lm_eval/tasks/babilong/babilong_qa16.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,752 copying build/lib/lm_eval/tasks/babilong/babilong_qa15.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,754 copying build/lib/lm_eval/tasks/babilong/babilong_longctx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,756 copying build/lib/lm_eval/tasks/babilong/babilong_qa13.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,758 copying build/lib/lm_eval/tasks/babilong/babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,760 copying build/lib/lm_eval/tasks/babilong/babilong_qa12.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,762 copying build/lib/lm_eval/tasks/babilong/babilong_qa20.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,763 copying build/lib/lm_eval/tasks/babilong/babilong_qa8.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,765 copying build/lib/lm_eval/tasks/babilong/babilong_qa19.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,767 copying build/lib/lm_eval/tasks/babilong/babilong_qa10.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,769 copying build/lib/lm_eval/tasks/babilong/babilong_qa18.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,771 copying build/lib/lm_eval/tasks/babilong/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,774 copying build/lib/lm_eval/tasks/babilong/babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,776 copying build/lib/lm_eval/tasks/babilong/babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,778 copying build/lib/lm_eval/tasks/babilong/babilong_qa6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,780 copying build/lib/lm_eval/tasks/babilong/babilong_qa9.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,782 copying build/lib/lm_eval/tasks/babilong/babilong_qa17.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,784 copying build/lib/lm_eval/tasks/babilong/babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,786 copying build/lib/lm_eval/tasks/babilong/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,788 copying build/lib/lm_eval/tasks/babilong/babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,790 copying build/lib/lm_eval/tasks/babilong/_babilong_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,792 copying build/lib/lm_eval/tasks/babilong/babilong_qa14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:39:47,794 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,796 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,798 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,800 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,802 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,804 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,806 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,808 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,810 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:39:47,813 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/csatqa 2026-09-01T00:39:47,814 copying build/lib/lm_eval/tasks/csatqa/_csatqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,816 copying build/lib/lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,818 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,820 copying build/lib/lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,822 copying build/lib/lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,824 copying build/lib/lm_eval/tasks/csatqa/csatqa_li.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,826 copying build/lib/lm_eval/tasks/csatqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,828 copying build/lib/lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,830 copying build/lib/lm_eval/tasks/csatqa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,832 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:39:47,835 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm 2026-09-01T00:39:47,837 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,838 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,840 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,842 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,844 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,846 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,848 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,850 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,852 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,854 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,856 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,858 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,860 copying build/lib/lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:39:47,862 copying build/lib/lm_eval/tasks/mgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-09-01T00:39:47,864 copying build/lib/lm_eval/tasks/mgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-09-01T00:39:47,867 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,868 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,870 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,872 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,873 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,875 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,877 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,879 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,881 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,883 copying build/lib/lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,885 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,887 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,889 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:39:47,891 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,892 copying build/lib/lm_eval/tasks/mgsm/direct/direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,894 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,896 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,898 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,900 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,902 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,904 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,907 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,908 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,910 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,912 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,914 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:39:47,916 copying build/lib/lm_eval/tasks/mgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-09-01T00:39:47,919 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meddialog 2026-09-01T00:39:47,920 copying build/lib/lm_eval/tasks/meddialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:39:47,922 copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:39:47,924 copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:39:47,926 copying build/lib/lm_eval/tasks/meddialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:39:47,928 copying build/lib/lm_eval/tasks/meddialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:39:47,930 copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:39:47,932 copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:39:47,937 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/belebele 2026-09-01T00:39:47,938 copying build/lib/lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,940 copying build/lib/lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,942 copying build/lib/lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,944 copying build/lib/lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,945 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,947 copying build/lib/lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,949 copying build/lib/lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,951 copying build/lib/lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,953 copying build/lib/lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,955 copying build/lib/lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,957 copying build/lib/lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,959 copying build/lib/lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,961 copying build/lib/lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,964 copying build/lib/lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,966 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,968 copying build/lib/lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,970 copying build/lib/lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,972 copying build/lib/lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,974 copying build/lib/lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,976 copying build/lib/lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,978 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,980 copying build/lib/lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,982 copying build/lib/lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,983 copying build/lib/lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,986 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,988 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,990 copying build/lib/lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,992 copying build/lib/lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,993 copying build/lib/lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,995 copying build/lib/lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,997 copying build/lib/lm_eval/tasks/belebele/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:47,999 copying build/lib/lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,001 copying build/lib/lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,003 copying build/lib/lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,005 copying build/lib/lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,006 copying build/lib/lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,008 copying build/lib/lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,010 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,012 copying build/lib/lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,014 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,016 copying build/lib/lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,017 copying build/lib/lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,019 copying build/lib/lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,021 copying build/lib/lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,023 copying build/lib/lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,024 copying build/lib/lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,026 copying build/lib/lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,028 copying build/lib/lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,030 copying build/lib/lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,032 copying build/lib/lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,033 copying build/lib/lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,035 copying build/lib/lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,037 copying build/lib/lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,039 copying build/lib/lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,040 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,042 copying build/lib/lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,044 copying build/lib/lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,046 copying build/lib/lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,048 copying build/lib/lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,050 copying build/lib/lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,052 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,055 copying build/lib/lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,057 copying build/lib/lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,059 copying build/lib/lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,061 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,063 copying build/lib/lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,065 copying build/lib/lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,067 copying build/lib/lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,069 copying build/lib/lm_eval/tasks/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,071 copying build/lib/lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,073 copying build/lib/lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,075 copying build/lib/lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,077 copying build/lib/lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,078 copying build/lib/lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,080 copying build/lib/lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,082 copying build/lib/lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,084 copying build/lib/lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,086 copying build/lib/lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,088 copying build/lib/lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,089 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,091 copying build/lib/lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,093 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,095 copying build/lib/lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,097 copying build/lib/lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,099 copying build/lib/lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,101 copying build/lib/lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,103 copying build/lib/lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,104 copying build/lib/lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,106 copying build/lib/lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,108 copying build/lib/lm_eval/tasks/belebele/_belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,110 copying build/lib/lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,112 copying build/lib/lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,114 copying build/lib/lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,116 copying build/lib/lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,118 copying build/lib/lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,120 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,121 copying build/lib/lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,123 copying build/lib/lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,125 copying build/lib/lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,126 copying build/lib/lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,128 copying build/lib/lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,129 copying build/lib/lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,131 copying build/lib/lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,133 copying build/lib/lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,134 copying build/lib/lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,136 copying build/lib/lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,138 copying build/lib/lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,139 copying build/lib/lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,141 copying build/lib/lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,143 copying build/lib/lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,145 copying build/lib/lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,146 copying build/lib/lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,148 copying build/lib/lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,150 copying build/lib/lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,151 copying build/lib/lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,153 copying build/lib/lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,155 copying build/lib/lm_eval/tasks/belebele/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,157 copying build/lib/lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,158 copying build/lib/lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,160 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,162 copying build/lib/lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,164 copying build/lib/lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,165 copying build/lib/lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,167 copying build/lib/lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,169 copying build/lib/lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,171 copying build/lib/lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:39:48,173 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paws-x 2026-09-01T00:39:48,174 copying build/lib/lm_eval/tasks/paws-x/paws_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,176 copying build/lib/lm_eval/tasks/paws-x/pawsx_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,178 copying build/lib/lm_eval/tasks/paws-x/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,179 copying build/lib/lm_eval/tasks/paws-x/_pawsx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,181 copying build/lib/lm_eval/tasks/paws-x/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,183 copying build/lib/lm_eval/tasks/paws-x/paws_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,184 copying build/lib/lm_eval/tasks/paws-x/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,186 copying build/lib/lm_eval/tasks/paws-x/paws_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,188 copying build/lib/lm_eval/tasks/paws-x/paws_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,190 copying build/lib/lm_eval/tasks/paws-x/paws_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,191 copying build/lib/lm_eval/tasks/paws-x/paws_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,193 copying build/lib/lm_eval/tasks/paws-x/paws_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:39:48,195 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/copal_id 2026-09-01T00:39:48,196 copying build/lib/lm_eval/tasks/copal_id/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-09-01T00:39:48,198 copying build/lib/lm_eval/tasks/copal_id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-09-01T00:39:48,200 copying build/lib/lm_eval/tasks/copal_id/standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-09-01T00:39:48,201 copying build/lib/lm_eval/tasks/copal_id/colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-09-01T00:39:48,204 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm 2026-09-01T00:39:48,205 copying build/lib/lm_eval/tasks/afrimgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:39:48,207 copying build/lib/lm_eval/tasks/afrimgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:39:48,209 copying build/lib/lm_eval/tasks/afrimgsm/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:39:48,211 copying build/lib/lm_eval/tasks/afrimgsm/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:39:48,213 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot 2026-09-01T00:39:48,214 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot 2026-09-01T00:39:48,217 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,218 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,220 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,222 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,223 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,225 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,226 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,228 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,230 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,231 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,233 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,235 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,237 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,238 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,240 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,242 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,243 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,245 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,247 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,249 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,250 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:39:48,253 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,254 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,256 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,257 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,259 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,261 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,263 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,264 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,266 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,267 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,269 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,271 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,272 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,274 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,276 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,277 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,279 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,281 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,282 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,284 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,286 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:39:48,288 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,289 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,291 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,293 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,294 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,296 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,298 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,300 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,301 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,303 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,304 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,306 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,308 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,309 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,311 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,313 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,315 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,316 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,318 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,320 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,322 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:39:48,325 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,326 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,328 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,330 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,332 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,334 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,336 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,338 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,340 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,342 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,343 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,345 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,347 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,349 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,351 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,353 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,354 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,356 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,358 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,360 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,362 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:39:48,365 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,366 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,368 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,370 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,372 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,374 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,376 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,378 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,380 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,382 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,383 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,385 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,387 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,389 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,392 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,394 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,396 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,398 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,400 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,402 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,404 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:39:48,406 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate 2026-09-01T00:39:48,408 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,410 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,412 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,414 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,416 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,418 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,420 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,422 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,424 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,426 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,428 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,430 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,431 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,433 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,435 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,437 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,439 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,441 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,443 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:39:48,445 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,446 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,448 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,450 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,452 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,455 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,458 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,460 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,462 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,463 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,466 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,468 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,470 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,471 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,473 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,475 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,477 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,479 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,481 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:39:48,483 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,484 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,486 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,488 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,490 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,492 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,494 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,496 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,498 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,500 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,502 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,504 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,506 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,509 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,511 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,513 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,515 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,517 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,518 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:39:48,520 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2026-09-01T00:39:48,523 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,524 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,526 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,527 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,529 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,531 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,533 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,535 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,537 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,539 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,541 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,543 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,545 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,547 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,549 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,551 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,553 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,555 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,557 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:39:48,559 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,561 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,563 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,565 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,566 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,568 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,570 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,572 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,573 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,575 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,577 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,579 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,581 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,583 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,584 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,586 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,588 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,590 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,592 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:39:48,594 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot 2026-09-01T00:39:48,596 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,597 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,599 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,601 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,602 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,604 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,606 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,608 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,610 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,611 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,613 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,615 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,617 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,619 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,621 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,623 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,624 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,626 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,628 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,630 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:39:48,632 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot 2026-09-01T00:39:48,634 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,635 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,637 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,639 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,640 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,642 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,644 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,646 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,648 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,650 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,651 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,653 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,655 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,657 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,659 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,661 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,663 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,665 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,667 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,669 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:39:48,671 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,672 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,674 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,677 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,678 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,680 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,682 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,684 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,686 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,687 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,689 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,691 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,693 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,695 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,697 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,699 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,701 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,703 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,704 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,706 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:39:48,709 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,710 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,712 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,714 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,716 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,718 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,719 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,721 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,723 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,725 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,727 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,729 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,730 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,732 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,734 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,736 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,738 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,740 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,742 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,744 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:39:48,747 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,748 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,750 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,751 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,753 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,755 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,757 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,759 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,761 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,762 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,764 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,766 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,768 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,770 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,772 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,774 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,776 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,778 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,779 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,781 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:39:48,784 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct 2026-09-01T00:39:48,786 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,787 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,789 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,791 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,793 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,794 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,796 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,798 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,800 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,802 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,804 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,805 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,807 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,809 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,811 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,813 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,815 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,817 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,819 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,821 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,823 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:39:48,826 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,827 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,829 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,831 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,833 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,835 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,837 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,838 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,840 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,842 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,844 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,846 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,848 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,850 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,852 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,854 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,856 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,858 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,860 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,862 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,864 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:39:48,866 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,867 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,870 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,871 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,873 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,875 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,877 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,879 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,881 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,883 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,885 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,887 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,888 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,890 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,892 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,894 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,895 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,897 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,899 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,901 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,903 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:39:48,904 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2026-09-01T00:39:48,907 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,908 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,910 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,911 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,913 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,915 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,917 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,919 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,921 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,923 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,924 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,926 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,928 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,929 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,931 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,933 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,934 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,936 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,938 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,940 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,942 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:39:48,944 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,945 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,947 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,949 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,951 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,953 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,954 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,956 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,958 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,960 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,962 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,964 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,965 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,967 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,969 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,970 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,972 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,974 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,976 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,977 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,979 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:39:48,981 copying build/lib/lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:39:48,984 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mlqa 2026-09-01T00:39:48,986 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:48,988 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:48,989 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:48,991 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:48,993 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:48,995 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:48,996 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:48,998 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,000 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,002 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,003 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,005 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,007 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,009 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,010 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,012 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,014 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,016 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,018 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,019 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,021 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,023 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,024 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,026 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,028 copying build/lib/lm_eval/tasks/mlqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,029 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,031 copying build/lib/lm_eval/tasks/mlqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,033 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,035 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,037 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,038 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,040 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,042 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,043 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,045 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,046 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,048 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,050 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,051 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,053 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,055 copying build/lib/lm_eval/tasks/mlqa/mlqa_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,057 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,058 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,060 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,062 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,064 copying build/lib/lm_eval/tasks/mlqa/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,065 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,067 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,068 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,070 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,072 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,073 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,075 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:39:49,077 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pisa 2026-09-01T00:39:49,078 copying build/lib/lm_eval/tasks/pisa/pisa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,080 copying build/lib/lm_eval/tasks/pisa/pisa_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,081 copying build/lib/lm_eval/tasks/pisa/pisa_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,083 copying build/lib/lm_eval/tasks/pisa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,085 copying build/lib/lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,086 copying build/lib/lm_eval/tasks/pisa/pisa_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,088 copying build/lib/lm_eval/tasks/pisa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,090 copying build/lib/lm_eval/tasks/pisa/pisa_en_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,092 copying build/lib/lm_eval/tasks/pisa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,094 copying build/lib/lm_eval/tasks/pisa/pisa_es_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,096 copying build/lib/lm_eval/tasks/pisa/_pisa_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,097 copying build/lib/lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,099 copying build/lib/lm_eval/tasks/pisa/pisa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,101 copying build/lib/lm_eval/tasks/pisa/_pisa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,103 copying build/lib/lm_eval/tasks/pisa/pisa_ch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,104 copying build/lib/lm_eval/tasks/pisa/pisa_it_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,106 copying build/lib/lm_eval/tasks/pisa/pisa_de_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:39:49,108 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click 2026-09-01T00:39:49,110 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click/click_lang 2026-09-01T00:39:49,111 copying build/lib/lm_eval/tasks/click/click_lang/_default_click_lang_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:39:49,113 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:39:49,115 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_function.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:39:49,116 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:39:49,118 copying build/lib/lm_eval/tasks/click/click_lang/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:39:49,120 copying build/lib/lm_eval/tasks/click/click_lang/_click_lang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:39:49,122 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,123 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,125 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_kpop.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,127 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_society.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,128 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,130 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_economy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,131 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,133 copying build/lib/lm_eval/tasks/click/click_cul/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,135 copying build/lib/lm_eval/tasks/click/click_cul/_default_click_cul_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,137 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_tradition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,138 copying build/lib/lm_eval/tasks/click/click_cul/_click_cul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,140 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:39:49,142 copying build/lib/lm_eval/tasks/click/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click 2026-09-01T00:39:49,144 copying build/lib/lm_eval/tasks/click/click.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click 2026-09-01T00:39:49,146 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogender 2026-09-01T00:39:49,147 copying build/lib/lm_eval/tasks/winogender/winogender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,149 copying build/lib/lm_eval/tasks/winogender/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,150 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,152 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,154 copying build/lib/lm_eval/tasks/winogender/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,156 copying build/lib/lm_eval/tasks/winogender/winogender_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,158 copying build/lib/lm_eval/tasks/winogender/winogender_neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,159 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,161 copying build/lib/lm_eval/tasks/winogender/winogender_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:39:49,163 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_prescriptions 2026-09-01T00:39:49,164 copying build/lib/lm_eval/tasks/med_prescriptions/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-09-01T00:39:49,168 copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-09-01T00:39:49,169 copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-09-01T00:39:49,171 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k 2026-09-01T00:39:49,172 copying build/lib/lm_eval/tasks/hrm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k 2026-09-01T00:39:49,174 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,175 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,177 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,179 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,180 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,182 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,184 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,185 copying build/lib/lm_eval/tasks/hrm8k/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,188 copying build/lib/lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:39:49,190 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,191 copying build/lib/lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,192 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,194 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,196 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,197 copying build/lib/lm_eval/tasks/hrm8k/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,200 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,201 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,203 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:39:49,205 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/indicxnli 2026-09-01T00:39:49,206 copying build/lib/lm_eval/tasks/indicxnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicxnli 2026-09-01T00:39:49,208 copying build/lib/lm_eval/tasks/indicxnli/indicxnli_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicxnli 2026-09-01T00:39:49,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,211 copying build/lib/lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,213 copying build/lib/lm_eval/tasks/xstorycloze/default_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,215 copying build/lib/lm_eval/tasks/xstorycloze/default_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,216 copying build/lib/lm_eval/tasks/xstorycloze/default_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,218 copying build/lib/lm_eval/tasks/xstorycloze/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,220 copying build/lib/lm_eval/tasks/xstorycloze/default_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,222 copying build/lib/lm_eval/tasks/xstorycloze/default_my.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,223 copying build/lib/lm_eval/tasks/xstorycloze/default_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,225 copying build/lib/lm_eval/tasks/xstorycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,226 copying build/lib/lm_eval/tasks/xstorycloze/default_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,228 copying build/lib/lm_eval/tasks/xstorycloze/default_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,230 copying build/lib/lm_eval/tasks/xstorycloze/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,231 copying build/lib/lm_eval/tasks/xstorycloze/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:39:49,234 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/groundcocoa 2026-09-01T00:39:49,235 copying build/lib/lm_eval/tasks/groundcocoa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-09-01T00:39:49,237 copying build/lib/lm_eval/tasks/groundcocoa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-09-01T00:39:49,238 copying build/lib/lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-09-01T00:39:49,240 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval 2026-09-01T00:39:49,242 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norrewrite-instruct 2026-09-01T00:39:49,243 copying build/lib/lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norrewrite-instruct 2026-09-01T00:39:49,245 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:39:49,247 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:49,248 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:49,250 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:49,252 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:49,253 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:49,255 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:39:49,257 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:39:49,258 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:39:49,261 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:49,262 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:49,264 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:49,265 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:49,267 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:49,269 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:39:49,271 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm 2026-09-01T00:39:49,272 copying build/lib/lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm 2026-09-01T00:39:49,274 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:49,275 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:49,277 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:49,279 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:49,281 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:49,282 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:49,284 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:39:49,286 copying build/lib/lm_eval/tasks/noreval/norsumm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm 2026-09-01T00:39:49,289 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:49,290 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:49,292 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:49,294 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:49,296 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:49,298 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:49,300 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:39:49,302 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ncb 2026-09-01T00:39:49,303 copying build/lib/lm_eval/tasks/noreval/ncb/ncb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ncb 2026-09-01T00:39:49,306 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa 2026-09-01T00:39:49,307 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa 2026-09-01T00:39:49,309 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:49,310 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:49,312 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:49,314 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:49,316 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:49,317 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:39:49,320 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:49,321 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:49,323 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:49,325 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:49,327 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:49,328 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:39:49,331 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa 2026-09-01T00:39:49,332 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:39:49,334 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:49,335 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:49,338 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:49,339 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:49,341 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:49,344 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:39:49,346 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:39:49,349 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:39:49,352 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:49,353 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:49,356 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:49,358 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:49,360 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:49,363 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:39:49,366 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-09-01T00:39:49,368 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:49,369 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:49,372 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:49,374 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:49,376 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:49,378 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:49,381 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:39:49,384 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:49,385 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:49,388 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:49,390 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:49,392 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:49,395 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:49,397 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:39:49,399 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-09-01T00:39:49,402 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba 2026-09-01T00:39:49,404 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:49,406 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:49,408 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:49,410 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:49,413 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:39:49,415 copying build/lib/lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba 2026-09-01T00:39:49,418 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:49,419 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:49,422 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:49,424 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:49,426 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:39:49,429 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:49,430 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:49,433 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:49,435 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:49,438 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:39:49,440 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:49,442 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:49,444 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:49,446 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:49,448 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:39:49,450 copying build/lib/lm_eval/tasks/noreval/noreval.jpg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval 2026-09-01T00:39:49,462 copying build/lib/lm_eval/tasks/noreval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval 2026-09-01T00:39:49,466 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsummarize-instruct 2026-09-01T00:39:49,467 copying build/lib/lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsummarize-instruct 2026-09-01T00:39:49,469 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,471 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,473 copying build/lib/lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,474 copying build/lib/lm_eval/tasks/noreval/ask_gec/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,477 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,478 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,480 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,482 copying build/lib/lm_eval/tasks/noreval/ask_gec/errant.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,484 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:39:49,487 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:49,488 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:49,490 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:49,492 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:49,493 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:49,495 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:49,497 copying build/lib/lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:39:49,500 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa 2026-09-01T00:39:49,501 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa 2026-09-01T00:39:49,503 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:49,504 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:49,506 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:49,509 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:49,511 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:49,512 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:49,514 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:39:49,517 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:49,518 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:49,520 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:49,522 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:49,524 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:49,525 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:49,527 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:39:49,530 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norquad 2026-09-01T00:39:49,531 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:39:49,533 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:39:49,534 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:39:49,536 copying build/lib/lm_eval/tasks/noreval/norquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:39:49,538 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:39:49,540 copying build/lib/lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:39:49,542 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:39:49,545 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec 2026-09-01T00:39:49,546 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:49,548 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:49,550 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:49,552 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:49,554 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:49,555 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:39:49,557 copying build/lib/lm_eval/tasks/noreval/norec/_norec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec 2026-09-01T00:39:49,559 copying build/lib/lm_eval/tasks/noreval/norec/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec 2026-09-01T00:39:49,562 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:49,563 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:49,565 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:49,567 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:49,569 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:49,571 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:39:49,573 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom 2026-09-01T00:39:49,574 copying build/lib/lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom 2026-09-01T00:39:49,577 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:49,578 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:49,580 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:49,582 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:49,584 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:49,586 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:39:49,588 copying build/lib/lm_eval/tasks/noreval/noridiom/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom 2026-09-01T00:39:49,590 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:49,591 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:49,593 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:49,596 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:49,598 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:49,600 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:39:49,602 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fda 2026-09-01T00:39:49,603 copying build/lib/lm_eval/tasks/fda/fda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-09-01T00:39:49,605 copying build/lib/lm_eval/tasks/fda/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-09-01T00:39:49,608 copying build/lib/lm_eval/tasks/fda/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-09-01T00:39:49,612 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bear 2026-09-01T00:39:49,613 copying build/lib/lm_eval/tasks/bear/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-09-01T00:39:49,616 copying build/lib/lm_eval/tasks/bear/bear_big.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-09-01T00:39:49,618 copying build/lib/lm_eval/tasks/bear/bear.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-09-01T00:39:49,621 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_cloze 2026-09-01T00:39:49,623 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-09-01T00:39:49,625 copying build/lib/lm_eval/tasks/lambada_cloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-09-01T00:39:49,628 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-09-01T00:39:49,630 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babi 2026-09-01T00:39:49,632 copying build/lib/lm_eval/tasks/babi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2026-09-01T00:39:49,634 copying build/lib/lm_eval/tasks/babi/babi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2026-09-01T00:39:49,637 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mastermind 2026-09-01T00:39:49,639 copying build/lib/lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:39:49,641 copying build/lib/lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:39:49,643 copying build/lib/lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:39:49,646 copying build/lib/lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:39:49,648 copying build/lib/lm_eval/tasks/mastermind/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:39:49,650 copying build/lib/lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:39:49,652 copying build/lib/lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:39:49,655 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xquad 2026-09-01T00:39:49,657 copying build/lib/lm_eval/tasks/xquad/xquad_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,659 copying build/lib/lm_eval/tasks/xquad/xquad_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,662 copying build/lib/lm_eval/tasks/xquad/xquad_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,664 copying build/lib/lm_eval/tasks/xquad/xquad_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,666 copying build/lib/lm_eval/tasks/xquad/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,668 copying build/lib/lm_eval/tasks/xquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,671 copying build/lib/lm_eval/tasks/xquad/xquad_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,673 copying build/lib/lm_eval/tasks/xquad/xquad_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,675 copying build/lib/lm_eval/tasks/xquad/xquad_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,677 copying build/lib/lm_eval/tasks/xquad/xquad_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,680 copying build/lib/lm_eval/tasks/xquad/xquad_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,682 copying build/lib/lm_eval/tasks/xquad/xquad_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,684 copying build/lib/lm_eval/tasks/xquad/xquad_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,686 copying build/lib/lm_eval/tasks/xquad/xquad_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,688 copying build/lib/lm_eval/tasks/xquad/xquad_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:39:49,691 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli 2026-09-01T00:39:49,693 copying build/lib/lm_eval/tasks/afrixnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-09-01T00:39:49,696 copying build/lib/lm_eval/tasks/afrixnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-09-01T00:39:49,698 copying build/lib/lm_eval/tasks/afrixnli/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-09-01T00:39:49,702 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate 2026-09-01T00:39:49,704 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,705 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,708 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,710 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,712 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,714 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,716 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,718 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,721 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,723 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,725 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,727 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,729 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,732 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,734 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,736 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,738 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,741 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,743 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,745 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:39:49,748 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,750 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,752 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,754 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,756 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,759 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,761 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,763 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,765 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,767 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,769 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,772 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,774 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,776 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,779 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,781 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,783 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,785 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,787 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,790 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:39:49,792 copying build/lib/lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate 2026-09-01T00:39:49,795 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,797 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,799 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,801 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,803 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,805 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,807 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,809 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,811 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,814 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,816 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,818 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,820 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,823 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,825 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,827 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,829 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,831 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,833 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,835 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:39:49,838 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,839 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,841 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,843 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,845 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,847 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,849 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,851 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,854 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,856 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,858 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,860 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,862 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,864 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,866 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,868 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,869 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,871 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,873 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,875 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:39:49,878 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,879 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,882 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,884 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,886 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,888 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,890 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,892 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,894 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,896 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,897 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,899 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,901 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,903 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,905 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,907 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,909 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,911 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,913 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,915 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:39:49,918 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt 2026-09-01T00:39:49,920 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,921 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,923 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,925 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,927 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,929 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,931 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,933 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,935 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,937 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,939 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,940 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,942 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,944 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,946 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,948 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,950 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,952 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,954 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,956 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:39:49,959 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,960 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,962 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,964 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,966 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,968 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,970 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,972 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,974 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,976 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,978 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,980 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,982 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,984 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,986 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,987 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,989 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,991 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,993 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,995 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:49,997 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:39:50,000 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct 2026-09-01T00:39:50,001 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,003 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,005 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,007 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,009 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,011 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,013 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,015 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,017 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,019 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,021 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,022 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,024 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,026 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,028 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,030 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,032 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,034 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,035 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,037 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,039 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:39:50,042 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,043 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,045 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,047 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,049 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,051 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,053 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,055 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,057 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,059 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,061 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,063 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,065 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,067 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,069 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,071 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,073 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,075 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,076 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,078 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,080 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:39:50,083 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,084 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,086 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,088 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,090 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,092 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,094 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,096 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,098 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,100 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,102 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,104 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,106 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,108 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,110 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,112 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,114 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,115 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,117 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,119 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,121 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:39:50,123 copying build/lib/lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct 2026-09-01T00:39:50,126 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,127 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,129 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,131 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,133 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,134 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,137 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,138 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,140 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,142 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,144 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,146 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,148 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,150 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,152 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,154 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,156 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,158 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,160 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,161 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,163 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:39:50,166 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,167 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,169 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,171 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,172 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,174 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,176 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,178 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,180 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,182 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,184 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,186 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,188 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,190 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,192 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,194 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,196 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,198 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,199 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,201 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,203 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:39:50,206 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt 2026-09-01T00:39:50,207 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,209 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,211 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,213 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,214 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,216 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,218 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,220 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,222 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,224 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,226 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,228 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,230 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,232 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,234 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,236 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,238 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,240 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,241 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,243 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,245 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:39:50,248 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,249 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,251 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,253 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,255 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,257 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,259 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,261 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,262 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,264 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,266 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,268 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,270 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,272 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,274 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,276 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,278 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,280 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,282 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,284 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,285 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:39:50,288 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,289 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,291 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,293 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,295 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,297 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,299 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,301 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,303 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,305 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,307 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,309 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,311 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,313 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,314 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,316 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,319 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,320 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,322 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,324 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:39:50,327 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture 2026-09-01T00:39:50,328 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,331 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,332 copying build/lib/lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,334 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,336 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,338 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,340 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,342 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,344 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,346 copying build/lib/lm_eval/tasks/arab_culture/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,348 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,350 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,352 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,354 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,356 copying build/lib/lm_eval/tasks/arab_culture/utils_mcq.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,358 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,360 copying build/lib/lm_eval/tasks/arab_culture/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,362 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,364 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,366 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,368 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,370 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,372 copying build/lib/lm_eval/tasks/arab_culture/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:39:50,375 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pubmedqa 2026-09-01T00:39:50,376 copying build/lib/lm_eval/tasks/pubmedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-09-01T00:39:50,378 copying build/lib/lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-09-01T00:39:50,380 copying build/lib/lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-09-01T00:39:50,384 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,385 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,387 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,388 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,390 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,393 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,394 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,396 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,398 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,400 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,402 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,404 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,406 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,408 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,410 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,411 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,414 copying build/lib/lm_eval/tasks/lm_syneval/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,415 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,417 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,419 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,421 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,423 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,425 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,427 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,428 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,430 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,432 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,434 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,436 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,438 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,439 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,441 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,443 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,445 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,447 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,449 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,451 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,453 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,455 copying build/lib/lm_eval/tasks/lm_syneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,458 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,460 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,462 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,463 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,466 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,467 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,469 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,471 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,473 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,475 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,477 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,479 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,481 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,483 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,485 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,487 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,489 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,490 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,493 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,495 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,497 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,499 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,502 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,504 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,506 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,508 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,510 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,512 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,514 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,516 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,518 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,520 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,522 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,524 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,526 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,528 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,530 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:39:50,532 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/agieval 2026-09-01T00:39:50,534 copying build/lib/lm_eval/tasks/agieval/logiqa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,536 copying build/lib/lm_eval/tasks/agieval/sat-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,538 copying build/lib/lm_eval/tasks/agieval/agieval_nous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,540 copying build/lib/lm_eval/tasks/agieval/agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,542 copying build/lib/lm_eval/tasks/agieval/lsat-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,544 copying build/lib/lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,546 copying build/lib/lm_eval/tasks/agieval/aqua-rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,548 copying build/lib/lm_eval/tasks/agieval/math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,549 copying build/lib/lm_eval/tasks/agieval/agieval_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,551 copying build/lib/lm_eval/tasks/agieval/gaokao-biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,553 copying build/lib/lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,555 copying build/lib/lm_eval/tasks/agieval/lsat-rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,557 copying build/lib/lm_eval/tasks/agieval/gaokao-physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,558 copying build/lib/lm_eval/tasks/agieval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,561 copying build/lib/lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,562 copying build/lib/lm_eval/tasks/agieval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,565 copying build/lib/lm_eval/tasks/agieval/gaokao-geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,567 copying build/lib/lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,568 copying build/lib/lm_eval/tasks/agieval/agieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,570 copying build/lib/lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,572 copying build/lib/lm_eval/tasks/agieval/logiqa-zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,574 copying build/lib/lm_eval/tasks/agieval/gaokao-english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,576 copying build/lib/lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,578 copying build/lib/lm_eval/tasks/agieval/sat-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,580 copying build/lib/lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,582 copying build/lib/lm_eval/tasks/agieval/gaokao-history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,584 copying build/lib/lm_eval/tasks/agieval/lsat-lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:39:50,588 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,589 copying build/lib/lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,591 copying build/lib/lm_eval/tasks/zhoblimp/verb_negation_particle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,593 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,595 copying build/lib/lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,597 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,599 copying build/lib/lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,601 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_SOV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,603 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,605 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,607 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,609 copying build/lib/lm_eval/tasks/zhoblimp/PN_numP_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,611 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,612 copying build/lib/lm_eval/tasks/zhoblimp/you_yige.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,614 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,616 copying build/lib/lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,618 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,620 copying build/lib/lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,621 copying build/lib/lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,623 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_nandao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,625 copying build/lib/lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,627 copying build/lib/lm_eval/tasks/zhoblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,629 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,631 copying build/lib/lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,633 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,635 copying build/lib/lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,637 copying build/lib/lm_eval/tasks/zhoblimp/agent_causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,639 copying build/lib/lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,641 copying build/lib/lm_eval/tasks/zhoblimp/BEI_construction_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,643 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,644 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,646 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,648 copying build/lib/lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,650 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,652 copying build/lib/lm_eval/tasks/zhoblimp/BA_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,654 copying build/lib/lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,656 copying build/lib/lm_eval/tasks/zhoblimp/BA_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,658 copying build/lib/lm_eval/tasks/zhoblimp/causative_shi_ba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,660 copying build/lib/lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,662 copying build/lib/lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,664 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,665 copying build/lib/lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,667 copying build/lib/lm_eval/tasks/zhoblimp/agent_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,669 copying build/lib/lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,671 copying build/lib/lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,673 copying build/lib/lm_eval/tasks/zhoblimp/BEI_construction_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,675 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,677 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,678 copying build/lib/lm_eval/tasks/zhoblimp/passive_intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,680 copying build/lib/lm_eval/tasks/zhoblimp/ya_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,682 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,684 copying build/lib/lm_eval/tasks/zhoblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,686 copying build/lib/lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,688 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,690 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,692 copying build/lib/lm_eval/tasks/zhoblimp/BA_no_progressive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,694 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,696 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,698 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,700 copying build/lib/lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,701 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,703 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,705 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,707 copying build/lib/lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,709 copying build/lib/lm_eval/tasks/zhoblimp/passive_suo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,711 copying build/lib/lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,712 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,714 copying build/lib/lm_eval/tasks/zhoblimp/modal_raising_hui.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,716 copying build/lib/lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,718 copying build/lib/lm_eval/tasks/zhoblimp/BA_inversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,719 copying build/lib/lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,721 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,723 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,725 copying build/lib/lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,726 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_OSV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,728 copying build/lib/lm_eval/tasks/zhoblimp/right_yijing_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,730 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,732 copying build/lib/lm_eval/tasks/zhoblimp/BA_meiba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,734 copying build/lib/lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,736 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,738 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,739 copying build/lib/lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,741 copying build/lib/lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,743 copying build/lib/lm_eval/tasks/zhoblimp/right_yijing_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,745 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_domain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,747 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,749 copying build/lib/lm_eval/tasks/zhoblimp/BEI_preposition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,751 copying build/lib/lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,753 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,755 copying build/lib/lm_eval/tasks/zhoblimp/BEI_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,756 copying build/lib/lm_eval/tasks/zhoblimp/PN_numP_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,758 copying build/lib/lm_eval/tasks/zhoblimp/relative_operator_who.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,760 copying build/lib/lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,762 copying build/lib/lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,763 copying build/lib/lm_eval/tasks/zhoblimp/passive_no_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,765 copying build/lib/lm_eval/tasks/zhoblimp/passive_body_part.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,767 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,769 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_d.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,771 copying build/lib/lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,773 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,774 copying build/lib/lm_eval/tasks/zhoblimp/zhoblimp_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,777 copying build/lib/lm_eval/tasks/zhoblimp/preposition_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,779 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,781 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,782 copying build/lib/lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,784 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,786 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,788 copying build/lib/lm_eval/tasks/zhoblimp/left_dou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,790 copying build/lib/lm_eval/tasks/zhoblimp/preposition_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,792 copying build/lib/lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,794 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,796 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,798 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,800 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,802 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,803 copying build/lib/lm_eval/tasks/zhoblimp/nominal_definite_men.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,806 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,808 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,809 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,811 copying build/lib/lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,813 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,815 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:39:50,818 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mts_dialog 2026-09-01T00:39:50,819 copying build/lib/lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:39:50,821 copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:39:50,823 copying build/lib/lm_eval/tasks/mts_dialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:39:50,824 copying build/lib/lm_eval/tasks/mts_dialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:39:50,826 copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:39:50,829 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,830 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,832 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,834 copying build/lib/lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,836 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,838 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,840 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,842 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,844 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,845 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,847 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,849 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,851 copying build/lib/lm_eval/tasks/med_concepts_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,854 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,857 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,859 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,861 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,863 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,866 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,868 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,870 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,872 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,874 copying build/lib/lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,877 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,879 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:39:50,882 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bhs 2026-09-01T00:39:50,884 copying build/lib/lm_eval/tasks/bhs/bhs_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,886 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,888 copying build/lib/lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,891 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,893 copying build/lib/lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,896 copying build/lib/lm_eval/tasks/bhs/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,898 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,901 copying build/lib/lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,903 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,906 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,908 copying build/lib/lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,910 copying build/lib/lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,913 copying build/lib/lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,915 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,918 copying build/lib/lm_eval/tasks/bhs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,921 copying build/lib/lm_eval/tasks/bhs/bhs_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,923 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,925 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,927 copying build/lib/lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,929 copying build/lib/lm_eval/tasks/bhs/hindi-S_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,931 copying build/lib/lm_eval/tasks/bhs/bhs_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,934 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,936 copying build/lib/lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,938 copying build/lib/lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,940 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,943 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,945 copying build/lib/lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:39:50,948 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite 2026-09-01T00:39:50,950 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,952 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/_toksuite_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,954 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_romanization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,956 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,958 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_equivalent_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,960 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,962 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_partially_romanized.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,964 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,966 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_traditional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,968 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_ocr_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,970 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,972 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,974 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_space_removal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,976 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_optional_diacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,978 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_word_spacing_zero-width_characters_extra_space.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,980 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_code_language_script_switching.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:39:50,982 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,983 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,986 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,987 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/_toksuite_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,989 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_code_language_script_switching.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,991 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,993 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_derivations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,995 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_inflections.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,997 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_similar_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:50,999 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,001 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_orthographic_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,003 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_english_keyboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,005 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_web_search_query.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,006 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,008 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_typographical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,010 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_equivalent_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,013 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,015 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_date_formats.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,017 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_grammatical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,018 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_word_reordering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:39:51,020 copying build/lib/lm_eval/tasks/toksuite/_toksuite_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite 2026-09-01T00:39:51,022 copying build/lib/lm_eval/tasks/toksuite/_toksuite_abridged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite 2026-09-01T00:39:51,024 copying build/lib/lm_eval/tasks/toksuite/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite 2026-09-01T00:39:51,027 copying build/lib/lm_eval/tasks/toksuite/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite 2026-09-01T00:39:51,030 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,032 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spaced_styling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,034 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_macron_diacritic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,035 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_lowercase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,037 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_emoji_substitution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,039 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,041 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_space_removal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,043 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_word_reordering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,045 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_substitution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,047 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,049 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_date_formats.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,050 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_capitalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,052 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_contractions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,054 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_ocr_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,056 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,058 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,060 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/_toksuite_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,062 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_web_search_query.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,063 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_scripted_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,065 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_grammatical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,067 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_letter_repetition_for_emphasis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,069 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_historical_spelling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,070 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_inflections.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,072 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_similar_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,074 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_hyphenated_spelling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,076 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_homoglyphs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,078 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,080 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_compounds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,082 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_superscript_subscript_styling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,084 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_abbreviations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,086 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_orthographic_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,087 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:39:51,090 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,091 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_romanization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,093 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,095 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,097 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,099 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,101 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_word_spacing_zero-width_characters_extra_space.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,102 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_code_language_script_switching.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,104 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,106 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_number_romanization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,108 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,110 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_optional_diacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,112 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_arabic_keyboard_for_farsi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,114 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_equivalent_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,116 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/_toksuite_farsi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:39:51,118 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,119 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_latex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,121 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,123 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_farsi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,125 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/_toksuite_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,127 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,129 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,131 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_space_removal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,133 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_decorative_unicode.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,134 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,137 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,138 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:39:51,141 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,142 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,144 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/_toksuite_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,146 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_capitalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,148 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_code_language_script_switching.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,149 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_plausible_diacritics_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,151 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_numerical_formats.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,153 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_phonetic_spelling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,155 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_similar_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,157 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_contractions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,159 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,161 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_date_formats.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,163 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_grammatical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,165 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_orthographic_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,167 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,168 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_web_search_query.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,170 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_english_keyboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,172 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_typographical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,174 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,176 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,178 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_abbreviations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:39:51,181 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,182 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_diacriticized_styling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,184 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_latex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,186 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_upside_down_rotated.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,188 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,190 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_enclosed_characters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,192 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,193 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_double_struck.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,195 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unusual_formatting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,197 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,199 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_strikethrough.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,201 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_morpheme_separation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,203 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/_toksuite_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,205 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_space_removal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,207 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_fullwidth_characters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,209 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_superscript_subscript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,210 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unicode_formatting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,212 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_typographical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,214 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_character_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,216 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_equivalent_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,218 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_scripted_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,220 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:39:51,222 copying build/lib/lm_eval/tasks/manager.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:39:51,225 copying build/lib/lm_eval/tasks/_yaml_loader.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:39:51,229 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,230 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,232 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,234 copying build/lib/lm_eval/tasks/evalita_llm/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,236 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,238 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,239 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,241 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,243 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,245 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,247 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,249 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,251 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,253 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,254 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,256 copying build/lib/lm_eval/tasks/evalita_llm/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,259 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,261 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,262 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,264 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,266 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,268 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,270 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,272 copying build/lib/lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,274 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,276 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,278 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,279 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,281 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,283 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,285 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,287 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,289 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,290 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,292 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,294 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,296 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,298 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,300 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,302 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,304 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,306 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,308 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,310 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,312 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,313 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,315 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,317 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,319 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,321 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,323 copying build/lib/lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,325 copying build/lib/lm_eval/tasks/evalita_llm/_re_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,327 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,329 copying build/lib/lm_eval/tasks/evalita_llm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,330 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,332 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,334 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,336 copying build/lib/lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,338 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,339 copying build/lib/lm_eval/tasks/evalita_llm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,342 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,344 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,346 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,348 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,349 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,351 copying build/lib/lm_eval/tasks/evalita_llm/_at_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,353 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,355 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,357 copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,359 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,361 copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,363 copying build/lib/lm_eval/tasks/evalita_llm/sum_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,365 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,367 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,369 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,371 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,373 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,375 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,377 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,378 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,380 copying build/lib/lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,382 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,384 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,386 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,388 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,390 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,391 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,393 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,395 copying build/lib/lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,397 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,399 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,401 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,403 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,405 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:39:51,408 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/infinitebench 2026-09-01T00:39:51,410 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_math_find.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,413 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longbook_qa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,415 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longbook_sum_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,417 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_code_debug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,419 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longbook_choice_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,421 copying build/lib/lm_eval/tasks/infinitebench/_infinitebench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,424 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_kv_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,426 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_passkey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,428 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longbook_qa_chn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,430 copying build/lib/lm_eval/tasks/infinitebench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,432 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_code_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,434 copying build/lib/lm_eval/tasks/infinitebench/infinitebench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,436 copying build/lib/lm_eval/tasks/infinitebench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,438 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_number_string.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,440 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longdialogue_qa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:39:51,443 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wsc273 2026-09-01T00:39:51,444 copying build/lib/lm_eval/tasks/wsc273/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-09-01T00:39:51,446 copying build/lib/lm_eval/tasks/wsc273/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-09-01T00:39:51,448 copying build/lib/lm_eval/tasks/wsc273/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-09-01T00:39:51,451 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa 2026-09-01T00:39:51,452 copying build/lib/lm_eval/tasks/logiqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-09-01T00:39:51,454 copying build/lib/lm_eval/tasks/logiqa/utils_logiqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-09-01T00:39:51,456 copying build/lib/lm_eval/tasks/logiqa/logiqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-09-01T00:39:51,459 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue 2026-09-01T00:39:51,460 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,462 copying build/lib/lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,464 copying build/lib/lm_eval/tasks/code_x_glue/code-text/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,466 copying build/lib/lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,468 copying build/lib/lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,470 copying build/lib/lm_eval/tasks/code_x_glue/code-text/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,472 copying build/lib/lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,474 copying build/lib/lm_eval/tasks/code_x_glue/code-text/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,476 copying build/lib/lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,478 copying build/lib/lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,480 copying build/lib/lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,482 copying build/lib/lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:39:51,484 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/histoires_morales 2026-09-01T00:39:51,486 copying build/lib/lm_eval/tasks/histoires_morales/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-09-01T00:39:51,488 copying build/lib/lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-09-01T00:39:51,490 copying build/lib/lm_eval/tasks/histoires_morales/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-09-01T00:39:51,492 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:39:51,493 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:39:51,496 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:39:51,498 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:39:51,500 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:39:51,502 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,504 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,506 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,508 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,510 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,512 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,513 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,516 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,518 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,520 copying build/lib/lm_eval/tasks/truthfulqa-multi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,521 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,523 copying build/lib/lm_eval/tasks/truthfulqa-multi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,526 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,528 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,530 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,532 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,534 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,536 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,538 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,540 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:39:51,542 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa 2026-09-01T00:39:51,544 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:51,545 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:51,547 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:51,549 copying build/lib/lm_eval/tasks/gpqa/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:51,551 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:51,553 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:51,554 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:39:51,557 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:51,558 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:51,560 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:51,562 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:51,564 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:51,566 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:51,568 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:39:51,570 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:51,571 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:51,573 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:51,575 copying build/lib/lm_eval/tasks/gpqa/n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:51,577 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:51,579 copying build/lib/lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:51,581 copying build/lib/lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:39:51,583 copying build/lib/lm_eval/tasks/gpqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa 2026-09-01T00:39:51,586 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:51,587 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:51,589 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:51,591 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:51,592 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:51,594 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:51,596 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:39:51,598 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/generative 2026-09-01T00:39:51,599 copying build/lib/lm_eval/tasks/gpqa/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:39:51,601 copying build/lib/lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:39:51,603 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:39:51,605 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:39:51,607 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:39:51,609 copying build/lib/lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:39:51,611 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/scrolls 2026-09-01T00:39:51,612 copying build/lib/lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,614 copying build/lib/lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,616 copying build/lib/lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,618 copying build/lib/lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,620 copying build/lib/lm_eval/tasks/scrolls/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,622 copying build/lib/lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,624 copying build/lib/lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,625 copying build/lib/lm_eval/tasks/scrolls/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,628 copying build/lib/lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:39:51,631 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,632 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,634 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,636 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,638 copying build/lib/lm_eval/tasks/hendrycks_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,640 copying build/lib/lm_eval/tasks/hendrycks_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,642 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,644 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,646 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,648 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,650 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,651 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:39:51,654 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox 2026-09-01T00:39:51,656 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,658 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,660 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,662 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,664 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,667 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,669 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,671 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,674 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,676 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,678 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,680 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,683 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,685 copying build/lib/lm_eval/tasks/mmlu_prox/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,688 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,690 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,692 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,695 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,697 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,699 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,702 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,704 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,707 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,709 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,711 copying build/lib/lm_eval/tasks/mmlu_prox/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,713 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,716 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,718 copying build/lib/lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,720 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,722 copying build/lib/lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,725 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,727 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,729 copying build/lib/lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,731 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:39:51,735 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,737 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,739 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,741 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,744 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,746 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,748 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,750 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,753 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,755 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,758 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,760 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,762 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,763 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,765 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,767 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,769 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,771 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,772 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,774 copying build/lib/lm_eval/tasks/mmlu_prox/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,776 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,778 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,780 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,782 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,784 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,786 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,788 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,790 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,792 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,794 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,795 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,797 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,799 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,801 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:39:51,804 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,805 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,807 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,809 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,811 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,813 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,815 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,817 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,818 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,820 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,822 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,824 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,826 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,827 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,830 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,831 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,833 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,835 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,837 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,839 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,841 copying build/lib/lm_eval/tasks/mmlu_prox/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,843 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,845 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,847 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,849 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,851 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,853 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,855 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,857 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,859 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,861 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,862 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,864 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,866 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:39:51,869 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,870 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,872 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,874 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,876 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,878 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,880 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,881 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,883 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,885 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,887 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,889 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,891 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,893 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,895 copying build/lib/lm_eval/tasks/mmlu_prox/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,897 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,899 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,901 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,902 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,904 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,906 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,908 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,910 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,912 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,913 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,915 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,917 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,919 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,921 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,923 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,925 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,927 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,929 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,931 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:39:51,934 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,935 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,937 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,939 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,941 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,943 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,944 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,946 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,948 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,950 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,953 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,955 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,956 copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,958 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,960 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,962 copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,964 copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,966 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,967 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,969 copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,971 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,973 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,975 copying build/lib/lm_eval/tasks/mmlu_prox/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,978 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,979 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,981 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,983 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,985 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,987 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,989 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,991 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,993 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,995 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:51,997 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:39:52,000 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,001 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,003 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,006 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,008 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,010 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,012 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,014 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,016 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,018 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,020 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,022 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,024 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,025 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,027 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,029 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,031 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,033 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,035 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,037 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,039 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,041 copying build/lib/lm_eval/tasks/mmlu_prox/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,043 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,045 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,047 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,049 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,052 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,054 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,056 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,058 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,060 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,062 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,064 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,066 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:39:52,070 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,071 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,073 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,075 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,077 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,079 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,081 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,083 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,085 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,087 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,089 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,091 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,093 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,096 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,098 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,100 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,102 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,104 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,107 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,109 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,111 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,113 copying build/lib/lm_eval/tasks/mmlu_prox/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,115 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,117 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,119 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,121 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,123 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,125 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,127 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,129 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,130 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,132 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,134 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,136 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:39:52,138 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,139 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,141 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,143 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,145 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,147 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,149 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,151 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,153 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,155 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,157 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,158 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,160 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,162 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,163 copying build/lib/lm_eval/tasks/mmlu_prox/mr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,165 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,167 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,169 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,170 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,172 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,174 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,175 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,177 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,179 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,181 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,182 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,184 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,186 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,188 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,190 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,192 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,194 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,196 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,198 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:39:52,200 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,201 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,203 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,205 copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,207 copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,209 copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,210 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,212 copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,214 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,215 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,217 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,219 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,220 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,222 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,224 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,226 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,228 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,230 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,232 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,233 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,236 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,237 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,239 copying build/lib/lm_eval/tasks/mmlu_prox/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,241 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,243 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,245 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,247 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,249 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,251 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,252 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,254 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,256 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,257 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,259 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:39:52,261 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,262 copying build/lib/lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,264 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,266 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,268 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,269 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,271 copying build/lib/lm_eval/tasks/mmlu_prox/af/_af_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,273 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,275 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,277 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,278 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,280 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,282 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,284 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,285 copying build/lib/lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,287 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,289 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,291 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,293 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,294 copying build/lib/lm_eval/tasks/mmlu_prox/af/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,296 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,298 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,300 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,301 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,303 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,305 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,306 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,308 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,309 copying build/lib/lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,311 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,313 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,314 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,316 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,317 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:39:52,320 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,321 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,323 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,325 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,326 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,328 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,330 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,332 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,333 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,335 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,337 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,338 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,340 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,342 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,344 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,345 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,347 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,349 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,350 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,352 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,353 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,355 copying build/lib/lm_eval/tasks/mmlu_prox/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,356 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,358 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,360 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,361 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,363 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,365 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,366 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,368 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,370 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,372 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,373 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,375 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:39:52,378 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,379 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,381 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,383 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,385 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,386 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,388 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,389 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,391 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,393 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,394 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,396 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,398 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,399 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,401 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,402 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,404 copying build/lib/lm_eval/tasks/mmlu_prox/wo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,406 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,407 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,409 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,411 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,412 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,414 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,416 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,418 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,419 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,421 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,423 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,425 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,426 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,428 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,430 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,431 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,433 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:39:52,434 copying build/lib/lm_eval/tasks/mmlu_prox/lang_libs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-09-01T00:39:52,438 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,439 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,441 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,442 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,444 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,445 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,447 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,449 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,450 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,452 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,453 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,455 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,457 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,458 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,460 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,462 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,464 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,466 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,468 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,470 copying build/lib/lm_eval/tasks/mmlu_prox/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,473 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,475 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,477 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,479 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,481 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,483 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,485 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,487 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,489 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,491 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,493 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,495 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,497 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,499 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:39:52,503 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,504 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,506 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,508 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,510 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,513 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,515 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,517 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,519 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,521 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,524 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,526 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,529 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,531 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,533 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,536 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,538 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,540 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,543 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,545 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,547 copying build/lib/lm_eval/tasks/mmlu_prox/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,549 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,552 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,554 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,557 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,559 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,561 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,564 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,566 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,568 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,570 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,572 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,574 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,576 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:39:52,578 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/template 2026-09-01T00:39:52,579 copying build/lib/lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template 2026-09-01T00:39:52,581 copying build/lib/lm_eval/tasks/mmlu_prox/template/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template 2026-09-01T00:39:52,585 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,586 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,588 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,590 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,592 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,593 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,595 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,597 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,599 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,601 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,603 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,605 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,607 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,609 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,611 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,613 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,615 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,617 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,618 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,620 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,623 copying build/lib/lm_eval/tasks/mmlu_prox/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,625 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,627 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,629 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,631 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,633 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,635 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,637 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,638 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,640 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,642 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,644 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,646 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,647 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:39:52,650 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,651 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,653 copying build/lib/lm_eval/tasks/mmlu_prox/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,655 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,657 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,659 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,661 copying build/lib/lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,663 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,665 copying build/lib/lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,667 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,669 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,671 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,673 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,675 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,677 copying build/lib/lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,679 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,681 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,683 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,685 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,687 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,689 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,691 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,693 copying build/lib/lm_eval/tasks/mmlu_prox/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,695 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,696 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,698 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,700 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,702 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,704 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,706 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,708 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,710 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,712 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,714 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:39:52,717 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,718 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,720 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,722 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,724 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,726 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,728 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,730 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,732 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,734 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,736 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,738 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,740 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,741 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,743 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,745 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,747 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,749 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,751 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,753 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,755 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,757 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,759 copying build/lib/lm_eval/tasks/mmlu_prox/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,761 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,762 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,764 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,766 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,768 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,770 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,772 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,774 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,776 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,778 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,780 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:39:52,782 copying build/lib/lm_eval/tasks/mmlu_prox/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-09-01T00:39:52,785 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,786 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,788 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,790 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,791 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,793 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,795 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,797 copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,799 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,801 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,803 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,805 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,807 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,809 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,811 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,813 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,815 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,817 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,819 copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,821 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,823 copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,825 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,827 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,829 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,831 copying build/lib/lm_eval/tasks/mmlu_prox/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,833 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,835 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,837 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,839 copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,841 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,843 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,845 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,846 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,848 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:39:52,851 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,852 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,854 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,857 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,859 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,860 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,862 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,864 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,866 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,868 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,870 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,872 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,874 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,876 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,878 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,880 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,882 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,884 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,886 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,888 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,890 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,892 copying build/lib/lm_eval/tasks/mmlu_prox/zu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,894 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,896 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,898 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,900 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,902 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,904 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,906 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,908 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,910 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,911 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,913 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,915 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:39:52,919 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,920 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,922 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,924 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,926 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,928 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,930 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,932 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,934 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,936 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,938 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,940 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,942 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,944 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,946 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,948 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,950 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,952 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,953 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,955 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,957 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,959 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,961 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,963 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,965 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,967 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,969 copying build/lib/lm_eval/tasks/mmlu_prox/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,972 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,973 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,975 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,977 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,979 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,981 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,983 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:39:52,986 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:52,987 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:52,989 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:52,991 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:52,993 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:52,994 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:52,996 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:52,998 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,000 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,002 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,004 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,006 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,007 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,009 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,011 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,013 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,015 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,017 copying build/lib/lm_eval/tasks/mmlu_prox/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,020 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,022 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,024 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,026 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,028 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,030 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,032 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,034 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,036 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,037 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,039 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,041 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,043 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,045 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,047 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,048 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:39:53,051 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,052 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,055 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,057 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,059 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,062 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,064 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,065 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,067 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,069 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,071 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,073 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,075 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,077 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,079 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,081 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,083 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,085 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,087 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,089 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,090 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,092 copying build/lib/lm_eval/tasks/mmlu_prox/hu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,094 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,096 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,098 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,100 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,102 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,104 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,106 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,108 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,109 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,111 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,113 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,115 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:39:53,118 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,119 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,121 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,123 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,125 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,127 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,129 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,131 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,133 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,135 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,137 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,139 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,141 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,143 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,144 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,146 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,148 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,150 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,152 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,154 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,156 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,157 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,159 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,161 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,163 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,165 copying build/lib/lm_eval/tasks/mmlu_prox/ur/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,167 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,169 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,171 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,173 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,175 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,177 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,179 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,180 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:39:53,182 copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-09-01T00:39:53,186 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,187 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,189 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,191 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,193 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,195 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,196 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,198 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,200 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,202 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,204 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,206 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,208 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,210 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,212 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,214 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,216 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,217 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,219 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,221 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,223 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,225 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,227 copying build/lib/lm_eval/tasks/mmlu_prox/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,229 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,231 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,233 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,235 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,237 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,239 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,241 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,243 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,244 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,246 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,248 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:39:53,251 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,252 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,255 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,256 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,258 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,261 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,263 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,264 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,266 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,268 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,270 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,272 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,274 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,276 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,278 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,280 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,282 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,284 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,286 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,288 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,289 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,291 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,293 copying build/lib/lm_eval/tasks/mmlu_prox/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,295 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,297 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,299 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,301 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,303 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,305 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,307 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,308 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,310 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,312 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,314 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:39:53,317 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,318 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,320 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,322 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,324 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,326 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,328 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,331 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,333 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,335 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,337 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,339 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,341 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,342 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,344 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,346 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,348 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,350 copying build/lib/lm_eval/tasks/mmlu_prox/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,352 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,354 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,357 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,358 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,360 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,362 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,364 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,367 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,369 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,371 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,373 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,375 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,377 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,379 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,381 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,383 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:39:53,386 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,387 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,389 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,390 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,392 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,394 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,396 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,398 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,400 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,401 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,403 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,405 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,407 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,409 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,411 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,413 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,415 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,417 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,418 copying build/lib/lm_eval/tasks/mmlu_prox/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,420 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,422 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,424 copying build/lib/lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,426 copying build/lib/lm_eval/tasks/mmlu_prox/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,428 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,430 copying build/lib/lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,432 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,434 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,436 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,438 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,439 copying build/lib/lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,441 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,443 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,445 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,447 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:39:53,449 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,450 copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,453 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,454 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,456 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,458 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,460 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,462 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,464 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,466 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,468 copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,470 copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,472 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,474 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,476 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,478 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,480 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,482 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,484 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,486 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,488 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,489 copying build/lib/lm_eval/tasks/mmlu_prox/th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,491 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,493 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,495 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,498 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,499 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,501 copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,503 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,505 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,507 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,509 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,511 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,513 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:39:53,515 copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-09-01T00:39:53,518 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,519 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,521 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,523 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,525 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,527 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,529 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,531 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,533 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,535 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,537 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,539 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,541 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,543 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,545 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,547 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,549 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,550 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,552 copying build/lib/lm_eval/tasks/mmlu_prox/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,554 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,556 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,558 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,560 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,562 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,564 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,566 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,568 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,570 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,572 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,574 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,576 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,578 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,580 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,582 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:39:53,585 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,586 copying build/lib/lm_eval/tasks/inverse_scaling/_some_results -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,588 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,590 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,591 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,593 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,595 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,597 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,599 copying build/lib/lm_eval/tasks/inverse_scaling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,601 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,603 copying build/lib/lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,605 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,607 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,608 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,610 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:39:53,613 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli 2026-09-01T00:39:53,614 copying build/lib/lm_eval/tasks/xnli/xnli_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,616 copying build/lib/lm_eval/tasks/xnli/xnli_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,618 copying build/lib/lm_eval/tasks/xnli/xnli_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,620 copying build/lib/lm_eval/tasks/xnli/xnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,622 copying build/lib/lm_eval/tasks/xnli/xnli_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,624 copying build/lib/lm_eval/tasks/xnli/xnli_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,626 copying build/lib/lm_eval/tasks/xnli/xnli_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,628 copying build/lib/lm_eval/tasks/xnli/xnli_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,630 copying build/lib/lm_eval/tasks/xnli/xnli_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,632 copying build/lib/lm_eval/tasks/xnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,634 copying build/lib/lm_eval/tasks/xnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,637 copying build/lib/lm_eval/tasks/xnli/xnli_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,639 copying build/lib/lm_eval/tasks/xnli/xnli_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,640 copying build/lib/lm_eval/tasks/xnli/xnli_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,642 copying build/lib/lm_eval/tasks/xnli/xnli_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,644 copying build/lib/lm_eval/tasks/xnli/_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,646 copying build/lib/lm_eval/tasks/xnli/xnli_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,648 copying build/lib/lm_eval/tasks/xnli/xnli_bg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,650 copying build/lib/lm_eval/tasks/xnli/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:39:53,653 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,654 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,656 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,658 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,660 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,662 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,664 copying build/lib/lm_eval/tasks/tinyBenchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,666 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,668 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,670 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,672 copying build/lib/lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,674 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,676 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,678 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:39:53,680 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu 2026-09-01T00:39:53,682 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,684 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,686 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,688 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,690 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,692 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,694 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,695 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,697 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,699 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,701 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,703 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,704 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,706 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,708 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,710 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,712 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,714 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,715 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,717 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,719 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,721 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,723 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,725 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,727 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,729 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,731 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,733 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,735 copying build/lib/lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,737 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,739 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,741 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,743 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,744 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,746 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,748 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,750 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,752 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,753 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,755 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,757 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,759 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,761 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,763 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,765 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,767 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,769 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,771 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,773 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,775 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,777 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,779 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:39:53,782 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,783 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,786 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,788 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,790 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,793 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,795 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,798 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,800 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,802 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,805 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,807 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,809 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,811 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,813 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,816 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,818 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,821 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,823 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,825 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,828 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,830 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,833 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,835 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,838 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,840 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,843 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,845 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,848 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,850 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,853 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,855 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,857 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,860 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,862 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,864 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,867 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,869 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,872 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,874 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,877 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,879 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,881 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,884 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,887 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,889 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,892 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,894 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,897 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,899 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,901 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,904 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:39:53,908 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,909 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,911 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,913 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,915 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,917 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,919 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,921 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,922 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,924 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,926 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,928 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,930 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,932 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,934 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,936 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,938 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,940 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,942 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,944 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,946 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,948 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,950 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,952 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,954 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,956 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,957 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,959 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,961 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,963 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,965 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,967 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,969 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,971 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,973 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,975 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,977 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,979 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,982 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,984 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,986 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,989 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,991 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,993 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,996 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:53,999 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:54,001 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:54,003 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:54,006 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:54,008 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:54,010 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:54,013 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:39:54,015 copying build/lib/lm_eval/tasks/kmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu 2026-09-01T00:39:54,019 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,021 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,023 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,026 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,028 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,030 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,032 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,035 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,037 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,040 copying build/lib/lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,042 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,044 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,046 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,049 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,051 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,054 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,056 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,058 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,061 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,063 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,065 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,067 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,069 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,072 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,074 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,076 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,078 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,080 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,082 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,084 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,086 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,088 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,090 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,092 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,094 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,096 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,098 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,100 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,102 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,104 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,106 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,108 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,110 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,112 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,114 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,115 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,117 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,119 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,121 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,123 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,125 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,127 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:39:54,130 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,131 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,133 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,135 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,137 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,139 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,141 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,143 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,145 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,147 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,149 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,151 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,153 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,155 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,157 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,158 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,160 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,162 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,164 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,166 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,168 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,170 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,171 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,173 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,175 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,177 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,179 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,181 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,183 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,185 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,187 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,189 copying build/lib/lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,191 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,193 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,195 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,197 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,199 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,201 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,203 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,205 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,207 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,208 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,210 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,212 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,214 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,216 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,217 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,219 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,221 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,223 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,225 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,227 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:39:54,229 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meqsum 2026-09-01T00:39:54,230 copying build/lib/lm_eval/tasks/meqsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-09-01T00:39:54,233 copying build/lib/lm_eval/tasks/meqsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-09-01T00:39:54,235 copying build/lib/lm_eval/tasks/meqsum/meqsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-09-01T00:39:54,237 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glianorex 2026-09-01T00:39:54,238 copying build/lib/lm_eval/tasks/glianorex/glianorex_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:39:54,240 copying build/lib/lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:39:54,242 copying build/lib/lm_eval/tasks/glianorex/glianorex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:39:54,244 copying build/lib/lm_eval/tasks/glianorex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:39:54,246 copying build/lib/lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:39:54,249 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egyhellaswag 2026-09-01T00:39:54,250 copying build/lib/lm_eval/tasks/egyhellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-09-01T00:39:54,252 copying build/lib/lm_eval/tasks/egyhellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-09-01T00:39:54,254 copying build/lib/lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-09-01T00:39:54,256 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swde 2026-09-01T00:39:54,257 copying build/lib/lm_eval/tasks/swde/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-09-01T00:39:54,260 copying build/lib/lm_eval/tasks/swde/swde.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-09-01T00:39:54,261 copying build/lib/lm_eval/tasks/swde/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-09-01T00:39:54,264 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cnn_dailymail 2026-09-01T00:39:54,265 copying build/lib/lm_eval/tasks/cnn_dailymail/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-09-01T00:39:54,267 copying build/lib/lm_eval/tasks/cnn_dailymail/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-09-01T00:39:54,269 copying build/lib/lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-09-01T00:39:54,272 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aclue 2026-09-01T00:39:54,273 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,275 copying build/lib/lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,277 copying build/lib/lm_eval/tasks/aclue/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,279 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,280 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,282 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,284 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,286 copying build/lib/lm_eval/tasks/aclue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,288 copying build/lib/lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,290 copying build/lib/lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,292 copying build/lib/lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,294 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,296 copying build/lib/lm_eval/tasks/aclue/_aclue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,297 copying build/lib/lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,299 copying build/lib/lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,301 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,303 copying build/lib/lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,305 copying build/lib/lm_eval/tasks/aclue/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,307 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:39:54,309 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:39:54,312 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,313 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,315 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,317 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,319 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,321 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,323 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,325 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,326 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,328 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,330 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,332 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,334 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,336 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,338 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,340 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,342 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,344 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,346 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,347 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,349 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,351 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,353 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,355 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,357 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,359 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,361 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,363 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,365 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,367 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,369 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,371 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,372 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,374 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,376 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,378 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,380 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,382 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,384 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,386 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,388 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,390 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,391 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,393 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,395 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,397 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,399 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,401 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,403 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,404 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,406 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,408 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,410 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,412 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,414 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,416 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,418 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,420 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,422 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,424 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:39:54,426 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:39:54,427 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:39:54,429 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:39:54,431 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:39:54,434 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,435 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,437 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,439 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,441 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,443 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,445 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,447 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,449 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,451 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,453 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,455 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:39:54,458 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,459 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,462 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,463 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,466 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,468 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,470 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,472 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,475 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,477 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,479 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,481 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,483 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,486 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,488 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,490 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,492 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,494 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,497 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,499 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,501 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,504 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,506 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,508 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,510 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,513 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,515 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,517 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,520 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,522 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,524 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,526 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,528 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,531 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,533 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,535 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,537 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,539 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,542 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,544 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,546 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,548 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,551 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,553 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,555 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,558 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,560 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,562 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,564 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,566 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,569 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,571 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,573 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,575 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,578 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,580 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,582 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,584 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,587 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,589 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,591 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:39:54,593 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:39:54,596 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:39:54,597 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:39:54,600 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:39:54,602 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:39:54,605 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:39:54,606 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:39:54,609 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:39:54,611 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:39:54,614 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:39:54,615 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:39:54,618 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:39:54,620 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:39:54,622 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:39:54,625 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:39:54,627 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:39:54,629 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:39:54,631 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:39:54,634 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:39:54,636 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:39:54,638 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:39:54,640 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:39:54,643 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:39:54,644 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:39:54,647 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:39:54,649 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:39:54,651 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:39:54,652 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:39:54,654 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:39:54,656 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:39:54,659 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:39:54,660 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:39:54,662 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:39:54,664 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:39:54,667 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:39:54,668 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:39:54,670 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:39:54,672 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:39:54,674 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:39:54,675 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:39:54,677 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:39:54,679 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:39:54,682 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:39:54,683 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:39:54,685 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:39:54,687 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:39:54,690 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada 2026-09-01T00:39:54,691 copying build/lib/lm_eval/tasks/lambada/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-09-01T00:39:54,693 copying build/lib/lm_eval/tasks/lambada/lambada_openai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-09-01T00:39:54,695 copying build/lib/lm_eval/tasks/lambada/lambada_standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-09-01T00:39:54,698 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/chartqa 2026-09-01T00:39:54,699 copying build/lib/lm_eval/tasks/chartqa/chartqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:39:54,701 copying build/lib/lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:39:54,703 copying build/lib/lm_eval/tasks/chartqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:39:54,704 copying build/lib/lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:39:54,706 copying build/lib/lm_eval/tasks/chartqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:39:54,709 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:54,710 copying build/lib/lm_eval/tasks/jsonschema_bench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:54,713 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:54,715 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:54,717 copying build/lib/lm_eval/tasks/jsonschema_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:54,719 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:39:54,722 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/physics_gre 2026-09-01T00:39:54,723 copying build/lib/lm_eval/tasks/physics_gre/physics_gre_additional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:39:54,725 copying build/lib/lm_eval/tasks/physics_gre/_physics_gre_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:39:54,727 copying build/lib/lm_eval/tasks/physics_gre/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:39:54,729 copying build/lib/lm_eval/tasks/physics_gre/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:39:54,731 copying build/lib/lm_eval/tasks/physics_gre/physics_gre_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:39:54,733 copying build/lib/lm_eval/tasks/physics_gre/physics_gre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:39:54,736 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/legalbench 2026-09-01T00:39:54,737 copying build/lib/lm_eval/tasks/legalbench/corporate_lobbying.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,739 copying build/lib/lm_eval/tasks/legalbench/contract_nli_notice_on_compelled_disclosure.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,741 copying build/lib/lm_eval/tasks/legalbench/contract_nli_sharing_with_employees.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,743 copying build/lib/lm_eval/tasks/legalbench/_contract_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,745 copying build/lib/lm_eval/tasks/legalbench/contract_nli_explicit_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,747 copying build/lib/lm_eval/tasks/legalbench/contract_nli_limited_use.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,749 copying build/lib/lm_eval/tasks/legalbench/contract_nli_return_of_confidential_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,751 copying build/lib/lm_eval/tasks/legalbench/_legalbench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,753 copying build/lib/lm_eval/tasks/legalbench/contract_nli_survival_of_obligations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,755 copying build/lib/lm_eval/tasks/legalbench/contract_nli_permissible_development_of_similar_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,757 copying build/lib/lm_eval/tasks/legalbench/contract_nli_no_licensing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,758 copying build/lib/lm_eval/tasks/legalbench/international_citizenship_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,760 copying build/lib/lm_eval/tasks/legalbench/contract_nli_sharing_with_third-parties.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,762 copying build/lib/lm_eval/tasks/legalbench/contract_nli_permissible_copy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,764 copying build/lib/lm_eval/tasks/legalbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,766 copying build/lib/lm_eval/tasks/legalbench/_legalbench_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,768 copying build/lib/lm_eval/tasks/legalbench/contract_nli_inclusion_of_verbally_conveyed_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,770 copying build/lib/lm_eval/tasks/legalbench/contract_nli_confidentiality_of_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,772 copying build/lib/lm_eval/tasks/legalbench/contract_nli_permissible_acquirement_of_similar_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,774 copying build/lib/lm_eval/tasks/legalbench/contract_nli_permissible_post-agreement_possession.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,776 copying build/lib/lm_eval/tasks/legalbench/abercrombie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,778 copying build/lib/lm_eval/tasks/legalbench/function_of_decision_section.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,780 copying build/lib/lm_eval/tasks/legalbench/proa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:39:54,782 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/slr_bench 2026-09-01T00:39:54,784 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,786 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,789 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,791 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,794 copying build/lib/lm_eval/tasks/slr_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,796 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,799 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,801 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_basic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,803 copying build/lib/lm_eval/tasks/slr_bench/lm_eval_slr_bench.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:39:54,807 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fld 2026-09-01T00:39:54,808 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:39:54,811 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:39:54,813 copying build/lib/lm_eval/tasks/fld/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:39:54,815 copying build/lib/lm_eval/tasks/fld/fld_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:39:54,818 copying build/lib/lm_eval/tasks/fld/fld_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:39:54,821 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squad_completion 2026-09-01T00:39:54,822 copying build/lib/lm_eval/tasks/squad_completion/squad_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-09-01T00:39:54,824 copying build/lib/lm_eval/tasks/squad_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-09-01T00:39:54,827 copying build/lib/lm_eval/tasks/squad_completion/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-09-01T00:39:54,830 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/asdiv 2026-09-01T00:39:54,831 copying build/lib/lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-09-01T00:39:54,834 copying build/lib/lm_eval/tasks/asdiv/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-09-01T00:39:54,836 copying build/lib/lm_eval/tasks/asdiv/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-09-01T00:39:54,839 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu 2026-09-01T00:39:54,843 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full 2026-09-01T00:39:54,846 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,848 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,850 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,853 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,855 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,858 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,860 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,862 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,865 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,867 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,870 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,872 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,875 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,877 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,880 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,882 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,884 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,886 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,888 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,889 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,891 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,893 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,895 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,897 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,899 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,901 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,903 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,904 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,906 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,908 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,910 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,912 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,914 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,916 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,918 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,920 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,922 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,924 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,926 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,928 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,930 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,932 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,934 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,936 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,937 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,939 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,941 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,943 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,945 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,947 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,949 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,951 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,953 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,955 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,957 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,959 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,961 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,963 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,965 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,967 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,969 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,970 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,972 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,974 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,976 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:39:54,980 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,981 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,983 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,985 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,987 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,989 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,991 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,993 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,995 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,997 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:54,999 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,001 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,003 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,005 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,007 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,009 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,011 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,013 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,014 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,016 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,018 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,020 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,022 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,024 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,026 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,028 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,030 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,032 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,034 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,036 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,038 copying build/lib/lm_eval/tasks/global_mmlu/full/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,040 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,043 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,045 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,047 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,049 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,051 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,053 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,055 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,058 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,060 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,062 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,064 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,066 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,068 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,070 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,072 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,074 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,077 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,079 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,081 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,083 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,085 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,088 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,090 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,092 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,094 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,097 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,099 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,101 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,103 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,105 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,107 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,109 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,111 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:39:55,115 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,117 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,119 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,121 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,123 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,126 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,128 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,130 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,132 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,134 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,137 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,139 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,141 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,143 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,146 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,148 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,150 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,152 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,154 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,156 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,158 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,160 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,163 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,165 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,167 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,169 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,171 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,174 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,176 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,178 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,180 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,183 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,185 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,187 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,189 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,192 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,194 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,196 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,198 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,200 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,202 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,204 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,206 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,208 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,211 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,213 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,215 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,217 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,219 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,222 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,224 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,226 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,228 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,230 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,232 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,235 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,237 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,239 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,241 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,243 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,245 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,247 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,250 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,252 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,254 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:39:55,258 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,259 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,261 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,264 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,266 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,268 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,270 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,272 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,274 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,277 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,279 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,281 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,283 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,285 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,288 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,290 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,292 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,294 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,296 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,298 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,301 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,303 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,305 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,307 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,309 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,312 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,314 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,316 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,318 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,320 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,323 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,325 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,327 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,329 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,331 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,333 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,334 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,336 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,338 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,340 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,342 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,343 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,345 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,347 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,349 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,351 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,353 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,355 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,356 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,358 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,360 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,362 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,364 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,366 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,368 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,370 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,372 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,374 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,375 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,377 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,379 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,381 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,383 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,384 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,386 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:39:55,390 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,391 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,393 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,395 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,397 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,399 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,400 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,402 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,404 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,406 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,408 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,410 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,412 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,414 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,416 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,417 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,419 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,421 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,423 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,425 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,427 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,428 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,430 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,432 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,434 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,436 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,438 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,440 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,441 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,443 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,445 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,447 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,449 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,451 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,453 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,455 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,457 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,458 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,460 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,462 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,464 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,466 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,468 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,470 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,471 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,473 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,475 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,477 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,479 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,481 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,483 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,485 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,487 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,488 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,490 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,492 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,494 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,496 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,498 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,500 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,501 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,503 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,505 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,507 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,509 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:39:55,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,513 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,515 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,517 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,519 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,521 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,523 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,525 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,527 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,529 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,531 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,532 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,534 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,536 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,538 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,540 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,542 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,543 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,545 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,547 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,549 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,551 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,552 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,554 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,556 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,558 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,560 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,562 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,564 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,565 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,567 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,569 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,571 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,573 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,575 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,577 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,579 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,581 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,583 copying build/lib/lm_eval/tasks/global_mmlu/full/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,584 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,586 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,588 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,591 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,593 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,595 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,597 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,600 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,602 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,604 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,607 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,609 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,612 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,614 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,617 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,619 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,621 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,624 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,626 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,629 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,631 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,633 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,635 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,637 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,639 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,642 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:39:55,646 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,648 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,650 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,653 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,656 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,658 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,661 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,663 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,665 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,667 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,670 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,672 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,674 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,677 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,679 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,681 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,683 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,686 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,688 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,690 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,692 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,694 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,696 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,697 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,699 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,702 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,704 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,705 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,707 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,709 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,711 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,713 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,714 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,716 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,718 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,720 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,722 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,723 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,725 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,727 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,729 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,730 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,732 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,734 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,736 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,738 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,740 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,741 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,743 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,745 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,747 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,749 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,751 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,753 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,755 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,757 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,758 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,760 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,762 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,764 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,766 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,768 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,769 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,771 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,773 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:39:55,777 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,778 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,780 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,781 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,783 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,785 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,787 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,789 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,791 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,793 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,794 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,796 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,798 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,800 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,802 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,804 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,806 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,808 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,810 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,812 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,814 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,815 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,817 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,819 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,821 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,823 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,825 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,827 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,829 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,831 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,833 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,834 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,836 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,838 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,840 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,842 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,844 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,846 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,848 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,850 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,852 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,854 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,856 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,857 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,859 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,861 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,863 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,865 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,867 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,869 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,871 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,872 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,874 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,876 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,878 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,880 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,882 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,883 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,886 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,887 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,889 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,891 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,893 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,895 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,897 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:39:55,900 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,901 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,903 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,905 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,907 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,909 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,911 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,913 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,915 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,916 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,918 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,920 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,922 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,924 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,926 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,928 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,929 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,931 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,933 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,935 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,937 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,939 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,940 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,942 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,944 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,946 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,948 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,950 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,952 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,954 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,956 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,957 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,959 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,961 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,963 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,965 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,967 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,969 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,971 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,972 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,974 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,976 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,978 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,980 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,981 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,983 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,985 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,987 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,988 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,990 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,992 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,994 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,996 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,998 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:55,999 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,001 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,003 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,005 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,007 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,009 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,010 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,012 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,014 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,016 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,018 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:39:56,021 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,022 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,024 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,026 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,028 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,030 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,032 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,034 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,035 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,037 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,039 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,041 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,043 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,045 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,047 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,049 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,051 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,052 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,054 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,056 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,058 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,060 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,062 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,063 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,065 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,067 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,069 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,071 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,073 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,075 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,076 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,078 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,080 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,082 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,084 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,086 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,088 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,090 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,092 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,094 copying build/lib/lm_eval/tasks/global_mmlu/full/am/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,095 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,097 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,099 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,101 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,103 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,104 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,106 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,108 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,110 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,112 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,114 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,116 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,118 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,120 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,121 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,123 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,125 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,127 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,129 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,131 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,133 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,134 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,136 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,138 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,140 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:39:56,144 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,145 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,147 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,149 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,150 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,152 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,154 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,156 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,158 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,160 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,162 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,163 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,165 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,167 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,169 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,171 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,173 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,175 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,176 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,178 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,180 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,182 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,183 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,185 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,187 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,189 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,191 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,193 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,195 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,196 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,198 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,200 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,202 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,204 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,206 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,208 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,209 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,211 copying build/lib/lm_eval/tasks/global_mmlu/full/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,213 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,215 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,217 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,219 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,220 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,222 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,224 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,226 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,228 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,229 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,231 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,233 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,235 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,237 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,239 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,241 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,243 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,245 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,246 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,248 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,250 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,252 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,254 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,256 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,257 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,259 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,261 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:39:56,264 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,265 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,267 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,269 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,271 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,273 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,275 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,277 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,279 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,281 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,283 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,285 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,286 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,288 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,290 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,292 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,294 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,296 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,298 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,299 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,301 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,303 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,305 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,307 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,309 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,310 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,312 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,314 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,316 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,318 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,320 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,321 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,323 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,325 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,327 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,329 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,331 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,333 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,335 copying build/lib/lm_eval/tasks/global_mmlu/full/el/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,336 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,338 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,340 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,342 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,343 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,345 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,347 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,349 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,351 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,353 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,354 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,356 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,358 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,360 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,362 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,364 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,366 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,368 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,370 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,372 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,373 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,375 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,377 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,379 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,381 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,382 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:39:56,386 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,387 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,389 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,391 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,393 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,395 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,397 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,400 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,402 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,404 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,406 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,409 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,411 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,413 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,416 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,418 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,421 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,423 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,425 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,428 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,430 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,432 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,434 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,437 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,439 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,441 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,443 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,445 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,448 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,450 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,452 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,454 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,457 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,459 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,461 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,464 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,466 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,468 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,471 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,473 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,475 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,478 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,480 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,482 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,484 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,487 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,489 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,491 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,494 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,495 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,498 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,499 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,501 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,503 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,505 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,507 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,509 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,510 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,512 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,514 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,516 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,518 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,520 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,522 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,523 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:39:56,527 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,528 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,530 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,532 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,534 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,536 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,537 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,539 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,541 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,543 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,545 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,547 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,548 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,550 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,552 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,554 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,556 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,558 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,559 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,561 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,563 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,565 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,566 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,568 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,570 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,572 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,574 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,576 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,578 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,580 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,581 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,583 copying build/lib/lm_eval/tasks/global_mmlu/full/so/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,585 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,587 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,589 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,591 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,593 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,595 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,597 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,599 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,600 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,602 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,604 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,606 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,608 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,610 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,612 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,613 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,615 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,617 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,619 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,621 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,622 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,624 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,626 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,628 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,630 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,632 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,634 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,637 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,638 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,640 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,642 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,644 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,646 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:39:56,650 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,651 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,653 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,655 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,656 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,658 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,660 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,662 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,664 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,666 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,668 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,670 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,672 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,673 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,676 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,677 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,679 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,681 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,683 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,685 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,686 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,688 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,690 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,692 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,693 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,695 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,697 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,699 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,701 copying build/lib/lm_eval/tasks/global_mmlu/full/si/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,703 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,704 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,706 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,708 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,710 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,712 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,714 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,715 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,717 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,719 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,721 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,723 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,725 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,726 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,728 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,730 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,732 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,734 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,736 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,738 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,739 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,741 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,743 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,745 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,747 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,749 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,751 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,752 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,754 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,757 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,759 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,760 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,762 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,764 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,766 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,768 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:39:56,772 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,773 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,775 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,777 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,779 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,781 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,783 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,785 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,787 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,788 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,790 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,792 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,794 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,796 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,798 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,800 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,802 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,804 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,806 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,808 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,810 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,812 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,814 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,816 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,818 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,820 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,822 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,824 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,826 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,827 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,829 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,831 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,833 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,835 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,837 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,839 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,841 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,843 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,845 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,847 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,849 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,852 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,854 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,856 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,858 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,860 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,862 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,865 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,867 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,869 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,871 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,873 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,876 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,878 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,880 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,882 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,885 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,887 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,889 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,892 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,894 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,896 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,898 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,901 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,903 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:39:56,907 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,908 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,911 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,913 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,915 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,918 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,920 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,922 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,924 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,927 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,929 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,931 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,934 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,936 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,938 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,940 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,942 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,945 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,947 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,949 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,951 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,954 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,956 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,958 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,960 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,962 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,964 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,966 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,968 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,970 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,972 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,974 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,976 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,978 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,980 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,982 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,983 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,985 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,987 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,989 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,991 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,993 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,995 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,997 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:56,998 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,000 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,002 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,004 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,006 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,008 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,010 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,012 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,014 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,016 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,018 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,019 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,021 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,023 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,025 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,027 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,029 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,031 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,033 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,035 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,037 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:39:57,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,041 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,043 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,045 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,047 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,051 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,053 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,056 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,058 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,060 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,061 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,063 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,066 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,068 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,070 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,072 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,074 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,076 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,078 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,079 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,081 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,083 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,085 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,087 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,089 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,091 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,093 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,095 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,097 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,098 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,100 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,102 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,104 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,106 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,108 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,110 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,112 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,114 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,116 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,118 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,119 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,121 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,123 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,125 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,127 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,129 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,131 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,133 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,135 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,137 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,139 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,141 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,143 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,145 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,147 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,149 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,150 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,152 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,154 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,156 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,158 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,160 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,162 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,164 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,166 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:39:57,169 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,171 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,173 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,175 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,177 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,179 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,181 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,183 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,185 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,187 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,189 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,190 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,192 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,194 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,196 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,198 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,200 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,203 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,205 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,207 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,210 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,212 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,214 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,217 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,219 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,221 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,223 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,226 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,228 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,230 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,233 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,235 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,238 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,240 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,242 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,245 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,248 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,250 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,252 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,255 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,257 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,259 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,262 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,264 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,266 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,268 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,271 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,273 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,275 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,277 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,279 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,282 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,284 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,286 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,289 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,291 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,293 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,296 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,298 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,300 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,302 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,304 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,305 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,307 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,309 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:39:57,312 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,313 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,315 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,317 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,319 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,321 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,323 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,325 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,327 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,329 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,331 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,333 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,335 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,337 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,339 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,341 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,343 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,345 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,347 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,349 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,351 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,352 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,354 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,356 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,358 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,360 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,362 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,364 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,366 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,368 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,369 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,371 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,373 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,375 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,377 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,379 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,381 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,383 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,385 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,387 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,389 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,390 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,392 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,394 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,396 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,398 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,399 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,401 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,403 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,405 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,407 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,409 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,411 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,413 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,415 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,417 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,419 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,421 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,423 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,425 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,427 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,429 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,431 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,432 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,434 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:39:57,438 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,439 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,441 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,443 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,445 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,447 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,449 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,450 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,452 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,454 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,456 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,458 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,460 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,462 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,464 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,466 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,468 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,470 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,472 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,474 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,476 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,477 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,479 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,481 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,483 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,485 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,487 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,489 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,490 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,492 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,494 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,496 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,498 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,500 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,502 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,504 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,506 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,508 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,510 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,512 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,514 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,515 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,517 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,519 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,521 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,522 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,524 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,526 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,528 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,530 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,532 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,534 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,536 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,538 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,540 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,542 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,544 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,546 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,548 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,550 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,552 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,554 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,555 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,557 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,559 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:39:57,563 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,564 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,566 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,568 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,570 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,571 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,573 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,575 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,577 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,579 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,581 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,583 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,585 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,587 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,589 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,591 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,593 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,595 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,597 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,598 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,600 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,602 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,604 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,606 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,608 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,610 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,611 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,613 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,615 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,617 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,619 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,621 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,623 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,625 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,627 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,629 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,631 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,633 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,635 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,637 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,639 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,640 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,642 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,644 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,646 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,648 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,650 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,651 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,653 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,655 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,657 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,659 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,661 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,663 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,665 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,667 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,669 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,671 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,673 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,675 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,677 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,679 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,681 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,683 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,685 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:39:57,688 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,689 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,691 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,693 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,696 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,697 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,699 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,701 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,703 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,705 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,707 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,709 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,711 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,713 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,715 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,717 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,719 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,721 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,723 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,725 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,727 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,729 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,731 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,733 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,734 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,736 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,738 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,740 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,742 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,744 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,746 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,748 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,749 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,751 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,753 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,755 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,757 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,759 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,761 copying build/lib/lm_eval/tasks/global_mmlu/full/he/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,763 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,765 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,767 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,769 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,771 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,773 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,774 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,776 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,778 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,780 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,782 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,784 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,785 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,787 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,789 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,791 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,793 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,795 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,797 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,799 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,800 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,802 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,804 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,806 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,808 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,810 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:39:57,814 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,815 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,817 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,819 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,820 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,822 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,824 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,826 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,828 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,830 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,832 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,833 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,835 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,837 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,839 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,841 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,843 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,845 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,847 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,849 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,851 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,852 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,854 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,856 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,858 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,860 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,861 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,863 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,865 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,867 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,869 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,871 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,872 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,874 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,876 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,878 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,880 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,882 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,884 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,886 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,888 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,890 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,892 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,894 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,896 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,897 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,899 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,901 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,903 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,905 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,907 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,909 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,911 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,912 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,914 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,916 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,918 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,920 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,922 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,924 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,926 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,928 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,930 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,931 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,933 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:39:57,937 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,938 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,940 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,941 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,943 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,945 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,947 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,949 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,951 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,953 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,955 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,957 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,958 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,960 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,962 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,964 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,966 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,968 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,970 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,972 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,974 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,976 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,977 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,979 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,981 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,983 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,985 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,987 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,988 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,990 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,992 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,994 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,996 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,997 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:57,999 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,001 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,003 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,006 copying build/lib/lm_eval/tasks/global_mmlu/full/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,009 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,011 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,013 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,016 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,018 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,020 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,023 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,025 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,027 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,029 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,031 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,034 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,036 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,038 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,040 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,043 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,045 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,048 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,050 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,053 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,055 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,058 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,060 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,062 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,065 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,067 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,069 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:39:58,074 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,075 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,077 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,080 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,082 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,084 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,086 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,089 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,091 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,094 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,096 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,099 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,102 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,104 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,106 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,108 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,110 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,112 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,113 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,115 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,117 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,119 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,121 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,123 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,125 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,127 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,128 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,130 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,132 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,134 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,136 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,138 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,140 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,141 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,143 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,145 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,147 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,149 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,151 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,153 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,155 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,157 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,159 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,161 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,163 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,165 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,167 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,169 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,171 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,173 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,175 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,177 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,179 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,181 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,183 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,185 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,187 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,189 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,191 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,193 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,195 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,197 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,199 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,200 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,202 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:39:58,206 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,207 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,209 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,211 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,213 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,215 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,217 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,219 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,221 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,223 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,225 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,227 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,228 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,230 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,232 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,234 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,236 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,238 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,240 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,242 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,244 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,246 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,248 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,250 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,251 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,253 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,255 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,257 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,259 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,261 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,263 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,265 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,267 copying build/lib/lm_eval/tasks/global_mmlu/full/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,269 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,271 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,273 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,275 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,277 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,279 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,281 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,283 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,285 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,287 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,288 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,290 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,292 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,294 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,296 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,297 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,299 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,301 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,303 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,305 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,307 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,309 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,310 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,312 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,314 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,316 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,318 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,320 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,322 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,324 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,326 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,328 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:39:58,331 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,332 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,334 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,336 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,338 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,340 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,342 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,343 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,345 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,347 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,349 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,351 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,353 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,355 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,357 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,359 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,361 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,362 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,364 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,366 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,368 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,370 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,372 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,374 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,376 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,377 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,379 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,381 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,383 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,385 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,387 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,389 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,390 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,392 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,394 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,396 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,398 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,400 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,402 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,404 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,406 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,407 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,409 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,411 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,413 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,415 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,417 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,419 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,420 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,422 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,424 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,426 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,428 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,429 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,431 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,433 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,435 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,437 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,439 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,441 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,442 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,444 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,446 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,448 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,450 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:39:58,453 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,454 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,457 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,458 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,460 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,462 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,464 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,466 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,467 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,469 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,471 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,473 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,475 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,477 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,479 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,481 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,482 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,484 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,486 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,488 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,490 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,492 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,494 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,495 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,497 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,499 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,501 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,503 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,504 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,506 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,508 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,510 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,512 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,514 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,515 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,517 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,519 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,521 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,523 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,525 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,527 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,529 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,531 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,532 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,534 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,536 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,538 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,540 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,542 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,543 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,545 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,547 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,549 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,551 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,553 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,554 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,556 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,558 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,560 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,562 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,564 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,566 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,568 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,570 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,572 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:39:58,575 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,576 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,578 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,580 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,582 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,584 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,585 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,587 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,589 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,591 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,593 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,595 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,597 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,598 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,600 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,602 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,604 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,606 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,608 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,610 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,612 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,614 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,616 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,618 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,619 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,621 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,623 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,625 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,627 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,629 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,630 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,632 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,634 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,636 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,638 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,640 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,642 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,644 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,646 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,648 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,650 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,651 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,653 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,655 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,657 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,659 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,661 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,663 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,664 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,666 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,668 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,670 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,672 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,674 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,676 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,678 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,680 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,682 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,684 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,686 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,688 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,690 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,692 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,693 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,695 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:39:58,699 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,700 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,702 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,704 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,706 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,707 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,709 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,711 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,713 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,715 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,717 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,718 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,720 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,722 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,724 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,726 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,728 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,730 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,732 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,734 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,736 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,738 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,739 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,741 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,743 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,745 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,747 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,749 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,750 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,752 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,754 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,756 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,758 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,760 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,762 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,764 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,766 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,767 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,769 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,771 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,773 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,775 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,777 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,779 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,781 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,783 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,785 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,787 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,788 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,790 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,792 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,794 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,796 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,798 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,800 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,802 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,804 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,806 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,807 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,809 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,811 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,813 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,815 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,817 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,819 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:39:58,823 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,824 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,826 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,827 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,829 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,831 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,833 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,835 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,837 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,838 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,840 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,842 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,844 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,846 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,848 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,850 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,852 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,854 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,856 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,858 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,859 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,861 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,863 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,865 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,867 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,869 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,870 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,872 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,874 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,876 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,878 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,879 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,881 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,883 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,885 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,887 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,889 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,891 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,892 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,894 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,896 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,898 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,900 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,902 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,904 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,906 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,908 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,909 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,911 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,913 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,915 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,917 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,919 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,921 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,922 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,924 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,926 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,928 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,930 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,932 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,934 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,936 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,938 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,940 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,942 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:39:58,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,946 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,948 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,950 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,952 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,954 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,956 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,958 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,959 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,961 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,963 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,965 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,967 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,969 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,971 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,973 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,974 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,976 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,978 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,980 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,982 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,984 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,986 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,988 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,989 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,991 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,993 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,995 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,997 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:58,999 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,001 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,002 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,004 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,007 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,009 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,011 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,013 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,015 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,016 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,018 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,020 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,022 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,024 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,026 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,028 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,030 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,032 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,033 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,035 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,037 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,039 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,041 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,043 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,045 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,047 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,048 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,050 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,052 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,054 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,056 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,058 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,060 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,062 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,064 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,066 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:39:59,070 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,071 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,074 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,076 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,078 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,080 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,082 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,085 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,087 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,089 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,091 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,093 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,095 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,098 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,100 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,102 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,104 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,106 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,108 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,110 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,113 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,116 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,118 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,120 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,122 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,124 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,127 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,129 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,131 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,133 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,136 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,138 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,140 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,142 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,144 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,147 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,149 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,151 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,153 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,155 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,158 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,160 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,162 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,164 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,167 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,169 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,171 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,173 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,175 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,177 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,180 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,182 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,184 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,186 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,188 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,190 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,192 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,195 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,197 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,199 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,201 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,203 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,206 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,208 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,210 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:39:59,215 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,216 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,219 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,221 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,223 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,225 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,227 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,229 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,231 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,233 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,236 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,238 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,240 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,242 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,244 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,247 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,249 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,251 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,254 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,256 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,258 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,261 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,263 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,265 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,267 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,269 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,271 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,273 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,276 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,278 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,280 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,282 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,284 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,286 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,288 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,291 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,293 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,295 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,298 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,300 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,303 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,305 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,307 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,309 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,311 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,314 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,316 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,318 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,320 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,322 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,324 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,326 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,328 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,330 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,333 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,335 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,337 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,339 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,341 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,343 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,345 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,347 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,350 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,352 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,354 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:39:59,358 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,359 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,362 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,364 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,366 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,368 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,370 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,372 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,374 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,376 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,379 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,381 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,383 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,385 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,387 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,389 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,391 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,393 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,395 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,398 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,400 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,402 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,404 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,406 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,408 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,410 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,412 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,415 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,417 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,419 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,421 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,423 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,425 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,427 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,430 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,432 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,434 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,436 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,438 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,440 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,442 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,444 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,446 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,449 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,451 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,453 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,455 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,457 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,459 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,461 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,463 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,466 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,468 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,470 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,472 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,474 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,476 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,479 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,481 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,483 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,485 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,487 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,490 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,492 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,494 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:39:59,498 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,500 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,502 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,504 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,506 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,508 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,510 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,513 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,515 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,517 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,519 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,522 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,524 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,526 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,528 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,530 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,532 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,534 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,536 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,538 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,540 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,543 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,545 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,547 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,549 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,552 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,554 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,556 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,558 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,560 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,562 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,565 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,567 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,569 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,571 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,573 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,576 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,578 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,580 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,583 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,585 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,587 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,589 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,592 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,594 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,596 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,598 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,600 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,602 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,605 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,607 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,609 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,611 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,614 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,616 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,618 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,620 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,622 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,624 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,627 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,629 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,631 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,633 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,635 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,638 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:39:59,642 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,643 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,645 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,647 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,649 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,651 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,653 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,655 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,657 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,659 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,660 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,662 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,664 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,666 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,668 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,670 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,671 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,673 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,675 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,677 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,679 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,681 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,683 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,685 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,686 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,688 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,690 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,692 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,694 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,696 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,697 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,699 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,701 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,703 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,705 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,707 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,709 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,711 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,712 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,715 copying build/lib/lm_eval/tasks/global_mmlu/full/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,716 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,718 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,720 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,722 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,724 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,726 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,728 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,730 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,732 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,733 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,735 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,737 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,739 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,741 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,743 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,744 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,746 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,748 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,750 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,752 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,754 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,756 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,758 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,760 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,762 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:39:59,765 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,767 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,769 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,770 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,772 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,774 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,776 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,778 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,780 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,781 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,783 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,785 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,787 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,789 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,791 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,793 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,795 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,797 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,799 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,801 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,802 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,804 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,806 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,809 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,810 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,812 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,814 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,816 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,818 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,819 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,821 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,823 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,825 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,827 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,829 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,831 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,833 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,835 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,836 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,838 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,840 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,842 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,844 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,846 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,848 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,850 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,852 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,854 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,856 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,857 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,859 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,861 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,863 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,865 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,867 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,869 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,871 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,873 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,875 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,877 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,879 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,881 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,883 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,885 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,886 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:39:59,890 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,891 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,893 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,895 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,897 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,899 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,901 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,902 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,904 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,906 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,908 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,910 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,912 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,914 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,916 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,918 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,920 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,922 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,924 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,926 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,928 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,930 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,931 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,933 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,935 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,937 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,939 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,941 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,942 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,944 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,946 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,948 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,950 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,951 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,953 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,955 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,957 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,959 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,961 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,963 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,965 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,967 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,968 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,970 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,972 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,974 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,976 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,978 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,979 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,981 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,983 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,985 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,987 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,988 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,990 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,992 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,994 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,996 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,998 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:39:59,999 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:40:00,001 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:40:00,003 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:40:00,005 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:40:00,007 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:40:00,009 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:40:00,012 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,013 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,016 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,018 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,020 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,022 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,024 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,026 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,028 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,030 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,032 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,034 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,036 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,038 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,039 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,041 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,043 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,045 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,047 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,049 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,051 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,053 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,055 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,057 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,059 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,060 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,062 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,064 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,066 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,068 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,070 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,071 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,073 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,075 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,077 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,079 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,081 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,083 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,085 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,087 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,089 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,091 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,092 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,094 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,096 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,098 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,100 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,102 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,104 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,106 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,107 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,109 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,111 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,113 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,115 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,117 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,118 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,120 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,122 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,124 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,127 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,129 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,131 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,133 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,135 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:40:00,139 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,140 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,142 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,144 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,146 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,148 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,150 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,151 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,153 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,155 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,157 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,159 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,161 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,163 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,165 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,166 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,168 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,170 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,172 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,174 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,176 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,178 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,180 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,182 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,184 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,186 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,188 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,189 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,191 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,193 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,195 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,197 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,199 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,201 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,203 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,205 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,207 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,209 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,210 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,212 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,214 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,217 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,218 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,221 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,223 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,226 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,228 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,230 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,233 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,235 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,237 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,239 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,242 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,244 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,247 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,249 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,251 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,253 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,256 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,258 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,261 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,263 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,265 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,268 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,270 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:40:00,273 copying build/lib/lm_eval/tasks/global_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu 2026-09-01T00:40:00,277 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default 2026-09-01T00:40:00,279 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,280 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,283 copying build/lib/lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,285 copying build/lib/lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,288 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,290 copying build/lib/lm_eval/tasks/global_mmlu/default/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,292 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,294 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,297 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,299 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:40:00,302 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,303 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,306 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,308 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,310 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,313 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,315 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,317 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,320 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,322 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:40:00,324 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,326 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,328 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,330 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,332 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,333 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,336 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,337 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,339 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,341 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:40:00,344 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,345 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,347 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,349 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,351 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,352 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,354 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,356 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,358 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,360 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:40:00,363 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,364 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,366 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,367 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,369 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,371 copying build/lib/lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,373 copying build/lib/lm_eval/tasks/global_mmlu/default/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,375 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,377 copying build/lib/lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,379 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:40:00,381 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,382 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,384 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,386 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,388 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,390 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,392 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,394 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,396 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,397 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:40:00,400 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,401 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,403 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,405 copying build/lib/lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,407 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,409 copying build/lib/lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,411 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,413 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,415 copying build/lib/lm_eval/tasks/global_mmlu/default/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,417 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:40:00,420 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,421 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,423 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,425 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,427 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,429 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,431 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,432 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,434 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,436 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:40:00,438 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,440 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,441 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,443 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,445 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,447 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,449 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,452 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,454 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,456 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:40:00,458 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,460 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,462 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,464 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,466 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,467 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,469 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,471 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,473 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,475 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:40:00,477 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,478 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,481 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,482 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,484 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,486 copying build/lib/lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,488 copying build/lib/lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,490 copying build/lib/lm_eval/tasks/global_mmlu/default/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,492 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,494 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:40:00,496 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,497 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,500 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,502 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,503 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,505 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,507 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,509 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,511 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,513 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:40:00,516 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,517 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,519 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,521 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,523 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,525 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,527 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,529 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,531 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,533 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:40:00,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,537 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,539 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,541 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,543 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,545 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,547 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,549 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,551 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,553 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:40:00,555 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,557 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,559 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,561 copying build/lib/lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,563 copying build/lib/lm_eval/tasks/global_mmlu/default/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,565 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,566 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,568 copying build/lib/lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,570 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,572 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:40:00,575 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench2 2026-09-01T00:40:00,576 copying build/lib/lm_eval/tasks/longbench2/news_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,578 copying build/lib/lm_eval/tasks/longbench2/translate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,580 copying build/lib/lm_eval/tasks/longbench2/graph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,582 copying build/lib/lm_eval/tasks/longbench2/_longbench2_structured.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,584 copying build/lib/lm_eval/tasks/longbench2/longbench2_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,586 copying build/lib/lm_eval/tasks/longbench2/_longbench2_incontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,588 copying build/lib/lm_eval/tasks/longbench2/agent_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,590 copying build/lib/lm_eval/tasks/longbench2/detective.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,591 copying build/lib/lm_eval/tasks/longbench2/_longbench2_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,593 copying build/lib/lm_eval/tasks/longbench2/govt_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,595 copying build/lib/lm_eval/tasks/longbench2/legal_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,597 copying build/lib/lm_eval/tasks/longbench2/table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,599 copying build/lib/lm_eval/tasks/longbench2/_longbench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,601 copying build/lib/lm_eval/tasks/longbench2/_longbench2_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,603 copying build/lib/lm_eval/tasks/longbench2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,605 copying build/lib/lm_eval/tasks/longbench2/dialogue_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,607 copying build/lib/lm_eval/tasks/longbench2/fin_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,609 copying build/lib/lm_eval/tasks/longbench2/lit_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,611 copying build/lib/lm_eval/tasks/longbench2/govt_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,613 copying build/lib/lm_eval/tasks/longbench2/many_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,615 copying build/lib/lm_eval/tasks/longbench2/_longbench2_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,617 copying build/lib/lm_eval/tasks/longbench2/event_order.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,619 copying build/lib/lm_eval/tasks/longbench2/fin_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,621 copying build/lib/lm_eval/tasks/longbench2/legal_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,623 copying build/lib/lm_eval/tasks/longbench2/academic_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,624 copying build/lib/lm_eval/tasks/longbench2/user_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,626 copying build/lib/lm_eval/tasks/longbench2/_longbench2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,628 copying build/lib/lm_eval/tasks/longbench2/academic_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:40:00,630 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,632 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,634 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,636 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,638 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,640 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,642 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,643 copying build/lib/lm_eval/tasks/japanese_leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,646 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,648 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,650 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,652 copying build/lib/lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,654 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,656 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,658 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,660 copying build/lib/lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:40:00,662 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench 2026-09-01T00:40:00,663 copying build/lib/lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,666 copying build/lib/lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,667 copying build/lib/lm_eval/tasks/basque_bench/paws_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,669 copying build/lib/lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,671 copying build/lib/lm_eval/tasks/basque_bench/basque_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,674 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,675 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,677 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,679 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,681 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,682 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,684 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,686 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,688 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,690 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,692 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,694 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,696 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,698 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,700 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,702 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,704 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,706 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,708 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,710 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:40:00,712 copying build/lib/lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,714 copying build/lib/lm_eval/tasks/basque_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,717 copying build/lib/lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,719 copying build/lib/lm_eval/tasks/basque_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,721 copying build/lib/lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,722 copying build/lib/lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:40:00,725 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/french_bench 2026-09-01T00:40:00,726 copying build/lib/lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,728 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,730 copying build/lib/lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,732 copying build/lib/lm_eval/tasks/french_bench/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,734 copying build/lib/lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,736 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,738 copying build/lib/lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,740 copying build/lib/lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,742 copying build/lib/lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,744 copying build/lib/lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,746 copying build/lib/lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,747 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,749 copying build/lib/lm_eval/tasks/french_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,752 copying build/lib/lm_eval/tasks/french_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,754 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,756 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,758 copying build/lib/lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,760 copying build/lib/lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,762 copying build/lib/lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,763 copying build/lib/lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,766 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,767 copying build/lib/lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:40:00,771 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijammlu 2026-09-01T00:40:00,772 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,774 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,776 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,778 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,780 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,782 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,784 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,786 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,788 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,790 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,792 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,794 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,796 copying build/lib/lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,798 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,800 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,802 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,804 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,806 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,808 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,810 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,812 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,815 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,817 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,819 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,821 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,823 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,825 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,827 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,829 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,831 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,833 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,835 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,837 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,839 copying build/lib/lm_eval/tasks/darijammlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,841 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,842 copying build/lib/lm_eval/tasks/darijammlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,844 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,846 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,848 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,850 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,852 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,854 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,856 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,858 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,860 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,862 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,864 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,866 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,868 copying build/lib/lm_eval/tasks/darijammlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,870 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,872 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:40:00,874 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,876 copying build/lib/lm_eval/tasks/kormedmcqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,878 copying build/lib/lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,880 copying build/lib/lm_eval/tasks/kormedmcqa/pharm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,881 copying build/lib/lm_eval/tasks/kormedmcqa/doctor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,883 copying build/lib/lm_eval/tasks/kormedmcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,885 copying build/lib/lm_eval/tasks/kormedmcqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,887 copying build/lib/lm_eval/tasks/kormedmcqa/dentist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,890 copying build/lib/lm_eval/tasks/kormedmcqa/nurse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:40:00,893 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cmmlu 2026-09-01T00:40:00,895 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,897 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,899 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,900 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,902 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,904 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,906 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,908 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,910 copying build/lib/lm_eval/tasks/cmmlu/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,912 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,914 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,916 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,918 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,919 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,921 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,923 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,925 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,927 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,929 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,931 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,933 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,935 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,936 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,938 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,940 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,942 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,944 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,945 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,947 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,949 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,951 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,953 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,955 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,957 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,959 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,960 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,962 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,964 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,966 copying build/lib/lm_eval/tasks/cmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,968 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,970 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,971 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,973 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,975 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,977 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,979 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,980 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,982 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,983 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,985 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,987 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,988 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,990 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,992 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,993 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,995 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,997 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:00,999 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,000 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,002 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,004 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,006 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,008 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,010 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,011 copying build/lib/lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,013 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,015 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,017 copying build/lib/lm_eval/tasks/cmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,020 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,022 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,024 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:40:01,027 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmmu 2026-09-01T00:40:01,028 copying build/lib/lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,030 copying build/lib/lm_eval/tasks/mmmu/_art_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,032 copying build/lib/lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,033 copying build/lib/lm_eval/tasks/mmmu/mmmu_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,035 copying build/lib/lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,037 copying build/lib/lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,039 copying build/lib/lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,040 copying build/lib/lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,042 copying build/lib/lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,044 copying build/lib/lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,046 copying build/lib/lm_eval/tasks/mmmu/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,047 copying build/lib/lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,049 copying build/lib/lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,051 copying build/lib/lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,053 copying build/lib/lm_eval/tasks/mmmu/mmmu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,055 copying build/lib/lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,057 copying build/lib/lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,059 copying build/lib/lm_eval/tasks/mmmu/_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,061 copying build/lib/lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,062 copying build/lib/lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,064 copying build/lib/lm_eval/tasks/mmmu/mmmu_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,066 copying build/lib/lm_eval/tasks/mmmu/_mmmu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,068 copying build/lib/lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,070 copying build/lib/lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,072 copying build/lib/lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,074 copying build/lib/lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,076 copying build/lib/lm_eval/tasks/mmmu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,078 copying build/lib/lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,080 copying build/lib/lm_eval/tasks/mmmu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,082 copying build/lib/lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,084 copying build/lib/lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,086 copying build/lib/lm_eval/tasks/mmmu/mmmu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,088 copying build/lib/lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,089 copying build/lib/lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,091 copying build/lib/lm_eval/tasks/mmmu/mmmu_art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,093 copying build/lib/lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,094 copying build/lib/lm_eval/tasks/mmmu/_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,096 copying build/lib/lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,098 copying build/lib/lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,099 copying build/lib/lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:40:01,102 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_trivia 2026-09-01T00:40:01,103 copying build/lib/lm_eval/tasks/eus_trivia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-09-01T00:40:01,105 copying build/lib/lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-09-01T00:40:01,106 copying build/lib/lm_eval/tasks/eus_trivia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-09-01T00:40:01,108 copying build/lib/lm_eval/tasks/_index.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:40:01,111 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include 2026-09-01T00:40:01,113 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en 2026-09-01T00:40:01,114 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:40:01,116 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:40:01,118 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:40:01,119 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:40:01,121 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:40:01,123 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:40:01,125 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:40:01,127 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,128 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,130 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,132 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,133 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,135 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,137 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,138 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,140 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,142 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,143 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,145 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:40:01,147 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,148 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,150 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,152 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,154 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,155 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,157 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,159 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,161 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,162 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:40:01,165 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:40:01,166 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:40:01,168 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:40:01,169 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:40:01,171 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:40:01,173 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:40:01,174 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:40:01,177 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,178 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,179 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,181 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,183 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,184 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,186 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,188 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,190 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:40:01,192 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,193 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,195 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,197 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,199 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,200 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,202 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,204 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,206 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,207 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:40:01,209 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,210 copying build/lib/lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,212 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,214 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,216 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,217 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,219 copying build/lib/lm_eval/tasks/include/few_shot_en/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,221 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,223 copying build/lib/lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:40:01,225 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:40:01,226 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:40:01,228 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:40:01,229 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:40:01,231 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:40:01,233 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:40:01,235 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,236 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,238 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,240 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,242 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,243 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,245 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,247 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,248 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:40:01,250 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,251 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,253 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,255 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,256 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,258 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,260 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,261 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,263 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,265 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:40:01,267 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:40:01,268 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:40:01,270 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:40:01,272 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:40:01,274 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:40:01,276 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:40:01,278 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,279 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,281 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,283 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,284 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,286 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,288 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,289 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,291 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:40:01,293 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:40:01,294 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:40:01,296 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:40:01,298 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:40:01,299 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:40:01,301 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:40:01,303 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:40:01,306 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,307 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,309 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,310 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,312 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,314 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,316 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,318 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,319 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:40:01,321 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,322 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,324 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,326 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,327 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,329 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,331 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,332 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,334 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:40:01,337 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:40:01,338 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:40:01,340 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:40:01,341 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:40:01,343 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:40:01,345 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:40:01,347 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:40:01,349 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:40:01,350 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:40:01,352 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:40:01,354 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:40:01,355 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:40:01,357 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:40:01,359 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:40:01,360 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:40:01,362 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:40:01,364 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:40:01,366 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:40:01,367 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:40:01,369 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:40:01,371 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:40:01,372 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:40:01,374 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:40:01,376 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:40:01,378 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:40:01,379 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:40:01,381 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:40:01,383 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,384 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,386 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,388 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,390 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,391 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,393 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,395 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,396 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:40:01,398 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,399 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,401 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,403 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,404 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,406 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,408 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,409 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,411 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,413 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:40:01,415 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:40:01,416 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:40:01,418 copying build/lib/lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:40:01,420 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:40:01,422 copying build/lib/lm_eval/tasks/include/few_shot_en/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:40:01,424 copying build/lib/lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:40:01,425 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:40:01,428 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:40:01,429 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:40:01,431 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:40:01,432 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:40:01,434 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:40:01,436 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:40:01,437 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:40:01,439 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:40:01,441 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:40:01,442 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:40:01,444 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:40:01,446 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:40:01,447 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:40:01,449 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:40:01,451 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:40:01,453 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:40:01,455 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:40:01,456 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:40:01,458 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:40:01,460 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:40:01,462 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_north_macedonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:40:01,464 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:40:01,465 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north_macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:40:01,467 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:40:01,470 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,471 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,473 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,475 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,476 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,478 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,480 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,482 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,484 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:40:01,486 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:40:01,487 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:40:01,489 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:40:01,491 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:40:01,493 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:40:01,494 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:40:01,496 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:40:01,498 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:40:01,500 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:40:01,502 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:40:01,504 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:40:01,505 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:40:01,507 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:40:01,509 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:40:01,510 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:40:01,512 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:40:01,514 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:40:01,516 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:40:01,517 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:40:01,519 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:40:01,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,523 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,525 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,526 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,528 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,530 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,532 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,533 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,535 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,537 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,539 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:40:01,541 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,542 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,544 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,546 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,547 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,549 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,551 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,552 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,554 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,556 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,557 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,559 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:40:01,561 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:40:01,562 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:40:01,564 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:40:01,566 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:40:01,568 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:40:01,570 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:40:01,571 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:40:01,574 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:40:01,575 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:40:01,577 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:40:01,579 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:40:01,580 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:40:01,582 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:40:01,584 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:40:01,586 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:40:01,587 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:40:01,589 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:40:01,590 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:40:01,592 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:40:01,594 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:40:01,595 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:40:01,597 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:40:01,599 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:40:01,600 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:40:01,602 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:40:01,604 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:40:01,606 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:40:01,608 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:40:01,610 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:40:01,612 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,614 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,616 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,618 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,620 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,621 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,623 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,625 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,626 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,628 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:40:01,630 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:40:01,631 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:40:01,633 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:40:01,635 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:40:01,637 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:40:01,639 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:40:01,640 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:40:01,643 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:40:01,644 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:40:01,646 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:40:01,648 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:40:01,650 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:40:01,652 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:40:01,654 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:40:01,656 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:40:01,658 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:40:01,659 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:40:01,661 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:40:01,663 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:40:01,665 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:40:01,667 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:40:01,669 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:40:01,670 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:40:01,672 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:40:01,673 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:40:01,675 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:40:01,677 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:40:01,678 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:40:01,680 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:40:01,682 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:40:01,684 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:40:01,686 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:40:01,687 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:40:01,689 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:40:01,692 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:40:01,693 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:40:01,695 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:40:01,698 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,699 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,701 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,703 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,705 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,707 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,708 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,710 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,712 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,713 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,715 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,717 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:40:01,719 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:40:01,720 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:40:01,722 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:40:01,724 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:40:01,726 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:40:01,728 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:40:01,730 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:40:01,732 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:40:01,734 copying build/lib/lm_eval/tasks/include/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include 2026-09-01T00:40:01,738 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og 2026-09-01T00:40:01,740 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:40:01,741 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:40:01,743 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:40:01,745 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:40:01,747 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:40:01,750 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:40:01,752 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:40:01,755 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,756 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,758 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,760 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,763 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,765 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,767 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,769 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,771 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,774 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,776 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,778 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:40:01,781 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,782 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,784 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,787 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,789 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,791 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,793 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,795 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,797 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,799 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:40:01,802 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:40:01,803 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:40:01,805 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:40:01,807 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:40:01,810 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:40:01,812 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:40:01,814 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:40:01,817 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,818 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,821 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,823 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,825 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,827 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,830 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,832 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,833 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:40:01,835 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,836 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,838 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,840 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,842 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,843 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,845 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,847 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,849 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,850 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:40:01,853 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,854 copying build/lib/lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,856 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,858 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,860 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,861 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,863 copying build/lib/lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,865 copying build/lib/lm_eval/tasks/include/few_shot_og/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,867 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:40:01,869 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:40:01,870 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:40:01,872 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:40:01,874 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:40:01,876 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:40:01,878 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:40:01,880 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,881 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,883 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,885 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,886 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,888 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,890 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,892 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,894 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:40:01,896 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,897 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,900 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,901 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,903 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,905 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,907 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,909 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,911 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,912 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:40:01,915 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:40:01,916 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:40:01,918 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:40:01,920 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:40:01,921 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:40:01,924 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:40:01,926 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,927 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,929 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,931 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,933 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,935 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,937 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,939 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,941 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:40:01,943 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:40:01,944 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:40:01,946 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:40:01,948 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:40:01,950 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:40:01,952 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:40:01,953 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:40:01,956 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,957 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,959 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,960 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,962 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,964 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,966 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,968 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,969 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:40:01,972 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,973 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,975 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,977 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,978 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,980 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,982 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,984 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,986 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:40:01,988 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:40:01,989 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:40:01,991 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:40:01,992 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:40:01,994 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:40:01,996 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:40:01,997 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:40:01,999 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:40:02,001 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:40:02,002 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:40:02,004 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:40:02,006 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:40:02,008 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:40:02,010 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:40:02,011 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:40:02,013 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:40:02,014 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:40:02,017 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:40:02,018 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:40:02,020 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:40:02,022 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:40:02,023 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:40:02,025 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:40:02,027 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:40:02,029 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:40:02,030 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:40:02,032 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:40:02,034 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,035 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,037 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,039 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,040 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,042 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,043 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,045 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,047 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:40:02,049 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,050 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,052 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,054 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,056 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,058 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,060 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,062 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,063 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,065 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:40:02,067 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:40:02,068 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:40:02,070 copying build/lib/lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:40:02,072 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:40:02,073 copying build/lib/lm_eval/tasks/include/few_shot_og/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:40:02,075 copying build/lib/lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:40:02,077 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:40:02,079 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:40:02,080 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:40:02,082 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:40:02,084 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:40:02,086 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:40:02,088 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:40:02,090 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:40:02,091 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:40:02,094 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:40:02,095 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:40:02,097 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:40:02,099 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:40:02,101 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:40:02,102 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:40:02,104 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:40:02,105 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:40:02,108 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:40:02,109 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:40:02,111 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:40:02,112 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:40:02,114 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_north_macedonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:40:02,116 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:40:02,117 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north_macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:40:02,119 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:40:02,122 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,123 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,125 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,126 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,128 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,130 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,132 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,134 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,135 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:40:02,138 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:40:02,139 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:40:02,140 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:40:02,142 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:40:02,144 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:40:02,146 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:40:02,148 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:40:02,149 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:40:02,151 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:40:02,152 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:40:02,154 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:40:02,156 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:40:02,158 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:40:02,160 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:40:02,161 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:40:02,163 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:40:02,165 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:40:02,167 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:40:02,168 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:40:02,170 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:40:02,173 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,174 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,176 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,178 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,179 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,181 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,183 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,184 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,186 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,188 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,189 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:40:02,192 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,193 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,195 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,197 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,198 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,200 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,202 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,204 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,206 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,207 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,209 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,211 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:40:02,214 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:40:02,215 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:40:02,216 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:40:02,218 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:40:02,220 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:40:02,221 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:40:02,223 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:40:02,225 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:40:02,227 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:40:02,228 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:40:02,230 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:40:02,232 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:40:02,233 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:40:02,235 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:40:02,237 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:40:02,238 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:40:02,240 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:40:02,242 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:40:02,244 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:40:02,246 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:40:02,247 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:40:02,249 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:40:02,251 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:40:02,253 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:40:02,254 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:40:02,256 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:40:02,258 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:40:02,260 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:40:02,261 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:40:02,264 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,265 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,266 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,268 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,270 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,272 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,274 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,275 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,277 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,279 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:40:02,281 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:40:02,282 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:40:02,284 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:40:02,286 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:40:02,288 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:40:02,290 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:40:02,291 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:40:02,293 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:40:02,294 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:40:02,296 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:40:02,298 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:40:02,300 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:40:02,302 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:40:02,303 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:40:02,305 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:40:02,307 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:40:02,308 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:40:02,310 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:40:02,312 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:40:02,314 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:40:02,315 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:40:02,318 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:40:02,319 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:40:02,321 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:40:02,323 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:40:02,324 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:40:02,327 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:40:02,328 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:40:02,330 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:40:02,331 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:40:02,333 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:40:02,335 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:40:02,336 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:40:02,338 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:40:02,340 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:40:02,341 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:40:02,343 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:40:02,346 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,347 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,349 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,351 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,352 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,354 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,356 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,358 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,360 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,362 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,364 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,366 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:40:02,368 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:40:02,369 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:40:02,371 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:40:02,373 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:40:02,374 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:40:02,376 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:40:02,378 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:40:02,379 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:40:02,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default 2026-09-01T00:40:02,384 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:40:02,385 copying build/lib/lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:40:02,387 copying build/lib/lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:40:02,389 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:40:02,391 copying build/lib/lm_eval/tasks/include/default/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:40:02,393 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:40:02,395 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:40:02,397 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,398 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,400 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,402 copying build/lib/lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,404 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,405 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,407 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,409 copying build/lib/lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,411 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,413 copying build/lib/lm_eval/tasks/include/default/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,414 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,416 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:40:02,418 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,419 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,421 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,423 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,424 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,426 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,428 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,429 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,431 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,433 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:40:02,435 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:40:02,436 copying build/lib/lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:40:02,439 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:40:02,440 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:40:02,442 copying build/lib/lm_eval/tasks/include/default/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:40:02,444 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:40:02,446 copying build/lib/lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:40:02,448 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,449 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,451 copying build/lib/lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,453 copying build/lib/lm_eval/tasks/include/default/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,454 copying build/lib/lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,456 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,458 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,460 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,461 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:40:02,464 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,465 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,467 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,469 copying build/lib/lm_eval/tasks/include/default/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,471 copying build/lib/lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,472 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,474 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,476 copying build/lib/lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,478 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,480 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:40:02,482 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/French 2026-09-01T00:40:02,483 copying build/lib/lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:40:02,485 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:40:02,487 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:40:02,489 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:40:02,491 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:40:02,492 copying build/lib/lm_eval/tasks/include/default/French/_french_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:40:02,494 copying build/lib/lm_eval/tasks/include/default/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:40:02,496 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:40:02,498 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Nepali 2026-09-01T00:40:02,499 copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:40:02,501 copying build/lib/lm_eval/tasks/include/default/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:40:02,503 copying build/lib/lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:40:02,504 copying build/lib/lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:40:02,506 copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:40:02,509 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,510 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,512 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,513 copying build/lib/lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,515 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,517 copying build/lib/lm_eval/tasks/include/default/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,519 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,520 copying build/lib/lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,522 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:40:02,525 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,526 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,528 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,529 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,531 copying build/lib/lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,533 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,534 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,536 copying build/lib/lm_eval/tasks/include/default/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,538 copying build/lib/lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,540 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:40:02,542 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:40:02,543 copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:40:02,545 copying build/lib/lm_eval/tasks/include/default/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:40:02,547 copying build/lib/lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:40:02,548 copying build/lib/lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:40:02,550 copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:40:02,553 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,554 copying build/lib/lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,555 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,557 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,559 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,561 copying build/lib/lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,563 copying build/lib/lm_eval/tasks/include/default/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,564 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,566 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:40:02,569 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Japanese 2026-09-01T00:40:02,570 copying build/lib/lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:40:02,572 copying build/lib/lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:40:02,573 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:40:02,575 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:40:02,577 copying build/lib/lm_eval/tasks/include/default/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:40:02,579 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:40:02,581 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,582 copying build/lib/lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,584 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,586 copying build/lib/lm_eval/tasks/include/default/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,588 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,590 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,591 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,593 copying build/lib/lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,595 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:40:02,597 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,598 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,600 copying build/lib/lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,602 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,604 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,606 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,608 copying build/lib/lm_eval/tasks/include/default/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,609 copying build/lib/lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,611 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:40:02,613 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:40:02,614 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:40:02,616 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:40:02,618 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:40:02,620 copying build/lib/lm_eval/tasks/include/default/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:40:02,621 copying build/lib/lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:40:02,623 copying build/lib/lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:40:02,625 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tamil 2026-09-01T00:40:02,626 copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:40:02,628 copying build/lib/lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:40:02,630 copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:40:02,632 copying build/lib/lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:40:02,634 copying build/lib/lm_eval/tasks/include/default/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:40:02,637 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:40:02,638 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:40:02,640 copying build/lib/lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:40:02,642 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:40:02,644 copying build/lib/lm_eval/tasks/include/default/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:40:02,646 copying build/lib/lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:40:02,648 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:40:02,650 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Serbian 2026-09-01T00:40:02,651 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:40:02,653 copying build/lib/lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:40:02,655 copying build/lib/lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:40:02,656 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:40:02,658 copying build/lib/lm_eval/tasks/include/default/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:40:02,660 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:40:02,662 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,663 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,665 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,667 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,669 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,670 copying build/lib/lm_eval/tasks/include/default/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,672 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,674 copying build/lib/lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,676 copying build/lib/lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:40:02,678 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,679 copying build/lib/lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,681 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,683 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,685 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,687 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,689 copying build/lib/lm_eval/tasks/include/default/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,691 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,692 copying build/lib/lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,694 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:40:02,697 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/German 2026-09-01T00:40:02,698 copying build/lib/lm_eval/tasks/include/default/German/_german_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:40:02,699 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:40:02,701 copying build/lib/lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:40:02,703 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:40:02,705 copying build/lib/lm_eval/tasks/include/default/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:40:02,706 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:40:02,709 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Telugu 2026-09-01T00:40:02,710 copying build/lib/lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:40:02,712 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:40:02,713 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:40:02,715 copying build/lib/lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:40:02,717 copying build/lib/lm_eval/tasks/include/default/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:40:02,719 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:40:02,720 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:40:02,723 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bengali 2026-09-01T00:40:02,724 copying build/lib/lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:40:02,726 copying build/lib/lm_eval/tasks/include/default/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:40:02,728 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:40:02,730 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:40:02,732 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:40:02,733 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:40:02,735 copying build/lib/lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:40:02,737 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:40:02,738 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:40:02,740 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:40:02,742 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:40:02,744 copying build/lib/lm_eval/tasks/include/default/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:40:02,746 copying build/lib/lm_eval/tasks/include/default/North Macedonian/_include_base_44_north_macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:40:02,747 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:40:02,749 copying build/lib/lm_eval/tasks/include/default/North Macedonian/_north_macedonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:40:02,751 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,752 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,754 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,756 copying build/lib/lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,758 copying build/lib/lm_eval/tasks/include/default/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,760 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,762 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,763 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,765 copying build/lib/lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:40:02,768 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Armenian 2026-09-01T00:40:02,769 copying build/lib/lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:40:02,771 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:40:02,772 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:40:02,774 copying build/lib/lm_eval/tasks/include/default/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:40:02,776 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:40:02,778 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:40:02,780 copying build/lib/lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:40:02,782 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Basque 2026-09-01T00:40:02,783 copying build/lib/lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-09-01T00:40:02,785 copying build/lib/lm_eval/tasks/include/default/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-09-01T00:40:02,787 copying build/lib/lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-09-01T00:40:02,789 copying build/lib/lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-09-01T00:40:02,791 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:40:02,792 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:40:02,794 copying build/lib/lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:40:02,796 copying build/lib/lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:40:02,798 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:40:02,800 copying build/lib/lm_eval/tasks/include/default/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:40:02,802 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:40:02,804 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,806 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,808 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,810 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,812 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,814 copying build/lib/lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,816 copying build/lib/lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,817 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,819 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,821 copying build/lib/lm_eval/tasks/include/default/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,823 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:40:02,825 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,826 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,828 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,830 copying build/lib/lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,832 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,833 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,835 copying build/lib/lm_eval/tasks/include/default/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,837 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,839 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,840 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,842 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,844 copying build/lib/lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:40:02,847 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Polish 2026-09-01T00:40:02,848 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:40:02,850 copying build/lib/lm_eval/tasks/include/default/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:40:02,852 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:40:02,854 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:40:02,856 copying build/lib/lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:40:02,858 copying build/lib/lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:40:02,861 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Urdu 2026-09-01T00:40:02,861 copying build/lib/lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:40:02,863 copying build/lib/lm_eval/tasks/include/default/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:40:02,865 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:40:02,867 copying build/lib/lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:40:02,869 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:40:02,870 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:40:02,872 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Spanish 2026-09-01T00:40:02,873 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:40:02,876 copying build/lib/lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:40:02,877 copying build/lib/lm_eval/tasks/include/default/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:40:02,879 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:40:02,881 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:40:02,883 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:40:02,885 copying build/lib/lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:40:02,887 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malay 2026-09-01T00:40:02,888 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:40:02,891 copying build/lib/lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:40:02,893 copying build/lib/lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:40:02,895 copying build/lib/lm_eval/tasks/include/default/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:40:02,897 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:40:02,898 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:40:02,901 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,902 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,904 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,906 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,907 copying build/lib/lm_eval/tasks/include/default/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,909 copying build/lib/lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,911 copying build/lib/lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,913 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,915 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,917 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:40:02,919 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Croatian 2026-09-01T00:40:02,920 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:40:02,922 copying build/lib/lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:40:02,924 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:40:02,925 copying build/lib/lm_eval/tasks/include/default/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:40:02,927 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:40:02,929 copying build/lib/lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:40:02,931 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Turkish 2026-09-01T00:40:02,933 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:40:02,935 copying build/lib/lm_eval/tasks/include/default/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:40:02,937 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:40:02,938 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:40:02,940 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:40:02,942 copying build/lib/lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:40:02,944 copying build/lib/lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:40:02,946 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Korean 2026-09-01T00:40:02,947 copying build/lib/lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:40:02,949 copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:40:02,950 copying build/lib/lm_eval/tasks/include/default/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:40:02,952 copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:40:02,954 copying build/lib/lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:40:02,956 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Georgian 2026-09-01T00:40:02,957 copying build/lib/lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-09-01T00:40:02,959 copying build/lib/lm_eval/tasks/include/default/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-09-01T00:40:02,961 copying build/lib/lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-09-01T00:40:02,963 copying build/lib/lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-09-01T00:40:02,965 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:40:02,966 copying build/lib/lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-09-01T00:40:02,968 copying build/lib/lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-09-01T00:40:02,970 copying build/lib/lm_eval/tasks/include/default/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-09-01T00:40:02,972 copying build/lib/lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-09-01T00:40:02,974 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:40:02,975 copying build/lib/lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:40:02,977 copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:40:02,979 copying build/lib/lm_eval/tasks/include/default/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:40:02,981 copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:40:02,982 copying build/lib/lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:40:02,985 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,986 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,987 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,989 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,991 copying build/lib/lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,992 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,994 copying build/lib/lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,996 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,998 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:02,999 copying build/lib/lm_eval/tasks/include/default/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:03,001 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:03,003 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:40:03,005 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:40:03,006 copying build/lib/lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:40:03,008 copying build/lib/lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:40:03,010 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:40:03,012 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:40:03,014 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:40:03,016 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:40:03,018 copying build/lib/lm_eval/tasks/include/default/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:40:03,021 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench 2026-09-01T00:40:03,022 copying build/lib/lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,024 copying build/lib/lm_eval/tasks/longbench/musique.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,026 copying build/lib/lm_eval/tasks/longbench/_longbench_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,028 copying build/lib/lm_eval/tasks/longbench/repobench-p.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,029 copying build/lib/lm_eval/tasks/longbench/multi_news_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,031 copying build/lib/lm_eval/tasks/longbench/_longbench_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,033 copying build/lib/lm_eval/tasks/longbench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,035 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,037 copying build/lib/lm_eval/tasks/longbench/passage_count_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,039 copying build/lib/lm_eval/tasks/longbench/_longbench_multi_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,040 copying build/lib/lm_eval/tasks/longbench/multi_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,042 copying build/lib/lm_eval/tasks/longbench/gov_report.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,044 copying build/lib/lm_eval/tasks/longbench/_longbench_synthetic_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,045 copying build/lib/lm_eval/tasks/longbench/_longbench_synthetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,047 copying build/lib/lm_eval/tasks/longbench/_longbench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,049 copying build/lib/lm_eval/tasks/longbench/qasper_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,051 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,053 copying build/lib/lm_eval/tasks/longbench/repobench-p_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,054 copying build/lib/lm_eval/tasks/longbench/lsht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,056 copying build/lib/lm_eval/tasks/longbench/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,058 copying build/lib/lm_eval/tasks/longbench/qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,060 copying build/lib/lm_eval/tasks/longbench/qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,062 copying build/lib/lm_eval/tasks/longbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,064 copying build/lib/lm_eval/tasks/longbench/_longbench_summarization_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,066 copying build/lib/lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,068 copying build/lib/lm_eval/tasks/longbench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,070 copying build/lib/lm_eval/tasks/longbench/hotpotqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,071 copying build/lib/lm_eval/tasks/longbench/triviaqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,073 copying build/lib/lm_eval/tasks/longbench/vcsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,075 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,077 copying build/lib/lm_eval/tasks/longbench/trec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,078 copying build/lib/lm_eval/tasks/longbench/lcc_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,080 copying build/lib/lm_eval/tasks/longbench/_longbench_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,082 copying build/lib/lm_eval/tasks/longbench/gov_report_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,083 copying build/lib/lm_eval/tasks/longbench/_longbench_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,085 copying build/lib/lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,087 copying build/lib/lm_eval/tasks/longbench/triviaqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,088 copying build/lib/lm_eval/tasks/longbench/lcc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,090 copying build/lib/lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,091 copying build/lib/lm_eval/tasks/longbench/_longbench_fewshot_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,093 copying build/lib/lm_eval/tasks/longbench/samsum_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,095 copying build/lib/lm_eval/tasks/longbench/2wikimqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,097 copying build/lib/lm_eval/tasks/longbench/_longbench_code_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,099 copying build/lib/lm_eval/tasks/longbench/_longbench_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,100 copying build/lib/lm_eval/tasks/longbench/narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,102 copying build/lib/lm_eval/tasks/longbench/samsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,104 copying build/lib/lm_eval/tasks/longbench/_longbench_summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,106 copying build/lib/lm_eval/tasks/longbench/dureader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,108 copying build/lib/lm_eval/tasks/longbench/trec_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,110 copying build/lib/lm_eval/tasks/longbench/passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,111 copying build/lib/lm_eval/tasks/longbench/_longbench_single_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,113 copying build/lib/lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:40:03,116 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi 2026-09-01T00:40:03,118 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,119 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,121 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,123 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,124 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,126 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,128 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,130 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,132 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,133 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,135 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,137 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,139 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,141 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,143 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,145 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,147 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,148 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,150 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,152 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,154 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,156 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,158 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,160 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,161 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,163 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,165 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,166 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,168 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,170 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,171 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,173 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,175 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,176 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:40:03,179 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,180 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,182 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,184 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,186 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,187 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,189 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,191 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,192 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,194 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,196 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,198 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,200 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,202 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,203 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,205 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,207 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,209 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,210 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,212 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,214 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,215 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,217 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,219 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,220 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,222 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,224 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,226 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,228 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,229 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,231 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,233 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,235 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,237 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,239 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,240 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,242 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:40:03,246 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,247 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,249 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,250 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,252 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,254 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,256 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,258 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,259 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,261 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,263 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,265 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,267 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,269 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,270 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,272 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,274 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,276 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,278 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,280 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,282 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,284 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,286 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,288 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,290 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,292 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,293 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,295 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,297 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,299 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,300 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,302 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,304 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,306 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,308 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,310 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,312 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,313 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,315 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,317 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,319 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,321 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,323 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,325 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,327 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,329 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,330 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,332 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,334 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,335 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,337 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,339 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,341 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,343 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,344 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,346 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,348 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,350 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,351 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,353 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,355 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,357 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,359 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,361 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,363 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,365 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,367 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:40:03,370 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,371 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,372 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,374 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,376 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,378 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,379 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,381 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,383 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,385 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,387 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,389 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,390 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,392 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,394 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,396 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,397 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,399 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,401 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,403 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,405 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,407 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,409 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,411 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,413 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,414 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,416 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,418 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,419 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,421 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,422 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,424 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,426 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,428 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,429 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:40:03,432 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kobest 2026-09-01T00:40:03,433 copying build/lib/lm_eval/tasks/kobest/kobest_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:40:03,435 copying build/lib/lm_eval/tasks/kobest/kobest_wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:40:03,437 copying build/lib/lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:40:03,439 copying build/lib/lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:40:03,440 copying build/lib/lm_eval/tasks/kobest/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:40:03,442 copying build/lib/lm_eval/tasks/kobest/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:40:03,444 copying build/lib/lm_eval/tasks/kobest/kobest_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:40:03,446 copying build/lib/lm_eval/tasks/kobest/_kobest.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:40:03,448 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/realtoxicityprompts 2026-09-01T00:40:03,449 copying build/lib/lm_eval/tasks/realtoxicityprompts/metric.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2026-09-01T00:40:03,451 copying build/lib/lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2026-09-01T00:40:03,454 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench 2026-09-01T00:40:03,455 copying build/lib/lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:40:03,458 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,459 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,461 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,463 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,465 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,467 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,469 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,470 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,472 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,474 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,476 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,478 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,480 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,482 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,483 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,485 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,487 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,489 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,490 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,492 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:40:03,494 copying build/lib/lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:40:03,496 copying build/lib/lm_eval/tasks/portuguese_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:40:03,498 copying build/lib/lm_eval/tasks/portuguese_bench/assin2_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:40:03,500 copying build/lib/lm_eval/tasks/portuguese_bench/assin2_sts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:40:03,502 copying build/lib/lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:40:03,504 copying build/lib/lm_eval/tasks/portuguese_bench/assin2_rte.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:40:03,506 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmdp 2026-09-01T00:40:03,507 copying build/lib/lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:40:03,509 copying build/lib/lm_eval/tasks/wmdp/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:40:03,511 copying build/lib/lm_eval/tasks/wmdp/_wmdp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:40:03,513 copying build/lib/lm_eval/tasks/wmdp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:40:03,515 copying build/lib/lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:40:03,517 copying build/lib/lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:40:03,519 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longproc 2026-09-01T00:40:03,520 copying build/lib/lm_eval/tasks/longproc/travel_planning_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,522 copying build/lib/lm_eval/tasks/longproc/html_to_tsv_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,524 copying build/lib/lm_eval/tasks/longproc/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,527 copying build/lib/lm_eval/tasks/longproc/tom_tracking_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,529 copying build/lib/lm_eval/tasks/longproc/pseudo_to_code_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,531 copying build/lib/lm_eval/tasks/longproc/tom_tracking_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,532 copying build/lib/lm_eval/tasks/longproc/path_traversal_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,534 copying build/lib/lm_eval/tasks/longproc/_default_yaml_0.5k -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,536 copying build/lib/lm_eval/tasks/longproc/_longproc_countdown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,538 copying build/lib/lm_eval/tasks/longproc/_longproc_tom_tracking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,540 copying build/lib/lm_eval/tasks/longproc/countdown_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,542 copying build/lib/lm_eval/tasks/longproc/tom_tracking_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,544 copying build/lib/lm_eval/tasks/longproc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,546 copying build/lib/lm_eval/tasks/longproc/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,548 copying build/lib/lm_eval/tasks/longproc/_default_yaml_8k -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,549 copying build/lib/lm_eval/tasks/longproc/path_traversal_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,551 copying build/lib/lm_eval/tasks/longproc/countdown_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,553 copying build/lib/lm_eval/tasks/longproc/_longproc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,555 copying build/lib/lm_eval/tasks/longproc/_longproc_pseudo_to_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,557 copying build/lib/lm_eval/tasks/longproc/_longproc_html_to_tsv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,559 copying build/lib/lm_eval/tasks/longproc/_longproc_path_traversal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,561 copying build/lib/lm_eval/tasks/longproc/countdown_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,563 copying build/lib/lm_eval/tasks/longproc/html_to_tsv_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,565 copying build/lib/lm_eval/tasks/longproc/_default_yaml_2k -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,566 copying build/lib/lm_eval/tasks/longproc/travel_planning_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,569 copying build/lib/lm_eval/tasks/longproc/html_to_tsv_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,570 copying build/lib/lm_eval/tasks/longproc/_longproc_travel_planning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,572 copying build/lib/lm_eval/tasks/longproc/path_traversal_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,574 copying build/lib/lm_eval/tasks/longproc/pseudo_to_code_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:40:03,577 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile 2026-09-01T00:40:03,578 copying build/lib/lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,580 copying build/lib/lm_eval/tasks/pile/pile_github.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,582 copying build/lib/lm_eval/tasks/pile/pile_enron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,583 copying build/lib/lm_eval/tasks/pile/pile_uspto.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,585 copying build/lib/lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,587 copying build/lib/lm_eval/tasks/pile/pile_books3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,589 copying build/lib/lm_eval/tasks/pile/pile_pile-cc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,591 copying build/lib/lm_eval/tasks/pile/pile_hackernews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,593 copying build/lib/lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,594 copying build/lib/lm_eval/tasks/pile/pile_europarl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,596 copying build/lib/lm_eval/tasks/pile/pile_arxiv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,598 copying build/lib/lm_eval/tasks/pile/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,600 copying build/lib/lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,601 copying build/lib/lm_eval/tasks/pile/pile_philpapers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,603 copying build/lib/lm_eval/tasks/pile/pile_gutenberg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,605 copying build/lib/lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,607 copying build/lib/lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,609 copying build/lib/lm_eval/tasks/pile/pile_stackexchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,611 copying build/lib/lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,613 copying build/lib/lm_eval/tasks/pile/pile_freelaw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,615 copying build/lib/lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,617 copying build/lib/lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,618 copying build/lib/lm_eval/tasks/pile/pile_wikipedia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:40:03,621 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/commonsense_qa 2026-09-01T00:40:03,622 copying build/lib/lm_eval/tasks/commonsense_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2026-09-01T00:40:03,624 copying build/lib/lm_eval/tasks/commonsense_qa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2026-09-01T00:40:03,626 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mathqa 2026-09-01T00:40:03,627 copying build/lib/lm_eval/tasks/mathqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-09-01T00:40:03,629 copying build/lib/lm_eval/tasks/mathqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-09-01T00:40:03,631 copying build/lib/lm_eval/tasks/mathqa/mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-09-01T00:40:03,633 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus 2026-09-01T00:40:03,634 copying build/lib/lm_eval/tasks/tmmluplus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2026-09-01T00:40:03,637 copying build/lib/lm_eval/tasks/tmmluplus/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2026-09-01T00:40:03,640 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,641 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,643 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,645 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,647 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,649 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,650 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,652 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,654 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,656 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,657 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,659 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,661 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,663 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,665 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,666 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,668 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,670 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,672 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,674 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,675 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,677 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,679 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,680 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,682 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,684 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,686 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,687 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,689 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,691 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,693 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,695 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,697 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,699 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,701 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,703 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,705 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,706 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,708 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,710 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,712 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,713 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,715 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,717 copying build/lib/lm_eval/tasks/tmmluplus/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,719 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,721 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,722 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,724 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,726 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,728 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,729 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,731 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,733 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,735 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,737 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,739 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,741 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,743 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,745 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,747 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,748 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,750 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,752 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,754 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,756 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,758 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,759 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,761 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,763 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,765 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,767 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,768 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,770 copying build/lib/lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,772 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,774 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,776 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:40:03,778 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks 2026-09-01T00:40:03,779 copying build/lib/lm_eval/tasks/benchmarks/pythia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:40:03,782 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/flan 2026-09-01T00:40:03,783 copying build/lib/lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-09-01T00:40:03,785 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-09-01T00:40:03,787 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-09-01T00:40:03,790 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:40:03,791 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:40:03,793 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:40:03,795 copying build/lib/lm_eval/tasks/benchmarks/minerva_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:40:03,796 copying build/lib/lm_eval/tasks/benchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:40:03,798 copying build/lib/lm_eval/tasks/benchmarks/t0_eval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:40:03,800 copying build/lib/lm_eval/tasks/benchmarks/openllm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:40:03,803 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,804 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,806 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,807 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,809 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,811 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,813 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,815 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,816 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,818 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,820 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,822 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,824 copying build/lib/lm_eval/tasks/crows_pairs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,826 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,828 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,829 copying build/lib/lm_eval/tasks/crows_pairs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,831 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,833 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,835 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,837 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,839 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,841 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,843 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,845 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,846 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:40:03,849 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bertaqa 2026-09-01T00:40:03,850 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,852 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,854 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,855 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,857 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,859 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,861 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,863 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,865 copying build/lib/lm_eval/tasks/bertaqa/_bertaqa_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,867 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,868 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,870 copying build/lib/lm_eval/tasks/bertaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,872 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,874 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,876 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,877 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,879 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,881 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:40:03,883 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijahellaswag 2026-09-01T00:40:03,884 copying build/lib/lm_eval/tasks/darijahellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-09-01T00:40:03,887 copying build/lib/lm_eval/tasks/darijahellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-09-01T00:40:03,888 copying build/lib/lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-09-01T00:40:03,891 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa 2026-09-01T00:40:03,893 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:40:03,894 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:40:03,896 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:40:03,898 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:40:03,899 copying build/lib/lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:40:03,901 copying build/lib/lm_eval/tasks/alghafa/copa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:40:03,903 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh 2026-09-01T00:40:03,905 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,906 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,908 copying build/lib/lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,910 copying build/lib/lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,912 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,913 copying build/lib/lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,915 copying build/lib/lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,917 copying build/lib/lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,918 copying build/lib/lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,920 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,922 copying build/lib/lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,924 copying build/lib/lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,926 copying build/lib/lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,928 copying build/lib/lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,930 copying build/lib/lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,932 copying build/lib/lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,934 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,936 copying build/lib/lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,937 copying build/lib/lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,939 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,941 copying build/lib/lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,943 copying build/lib/lm_eval/tasks/bbh/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,946 copying build/lib/lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,948 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,950 copying build/lib/lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,952 copying build/lib/lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,954 copying build/lib/lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,956 copying build/lib/lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,958 copying build/lib/lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,960 copying build/lib/lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,962 copying build/lib/lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:40:03,964 copying build/lib/lm_eval/tasks/bbh/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2026-09-01T00:40:03,968 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,969 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,972 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,974 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,977 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,979 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,982 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,984 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,986 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,988 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,991 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,993 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,995 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:03,998 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,000 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,002 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,005 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,007 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,009 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,012 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,014 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,017 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,019 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,022 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,024 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,027 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,029 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,031 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,033 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,036 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,038 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:40:04,042 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,043 copying build/lib/lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,046 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,048 copying build/lib/lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,050 copying build/lib/lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,052 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,055 copying build/lib/lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,057 copying build/lib/lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,059 copying build/lib/lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,061 copying build/lib/lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,063 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,065 copying build/lib/lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,067 copying build/lib/lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,069 copying build/lib/lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,070 copying build/lib/lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,072 copying build/lib/lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,074 copying build/lib/lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,076 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,078 copying build/lib/lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,079 copying build/lib/lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,081 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,083 copying build/lib/lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,085 copying build/lib/lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,087 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,089 copying build/lib/lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,091 copying build/lib/lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,093 copying build/lib/lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,095 copying build/lib/lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,097 copying build/lib/lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,099 copying build/lib/lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:40:04,103 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,104 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,106 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,108 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,110 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,112 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,114 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,116 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,118 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,120 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,122 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,124 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,126 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,128 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,130 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,132 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,134 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,136 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,138 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,140 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,142 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,144 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,146 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,148 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,150 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,152 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,154 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,156 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,158 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,160 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,162 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:40:04,164 copying build/lib/lm_eval/tasks/bbh/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2026-09-01T00:40:04,166 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_text_classification 2026-09-01T00:40:04,167 copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-09-01T00:40:04,169 copying build/lib/lm_eval/tasks/med_text_classification/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-09-01T00:40:04,171 copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-09-01T00:40:04,173 copying build/lib/lm_eval/tasks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:40:04,177 copying build/lib/lm_eval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:40:04,180 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/discrim_eval 2026-09-01T00:40:04,181 copying build/lib/lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-09-01T00:40:04,183 copying build/lib/lm_eval/tasks/discrim_eval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-09-01T00:40:04,185 copying build/lib/lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-09-01T00:40:04,187 copying build/lib/lm_eval/tasks/discrim_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-09-01T00:40:04,190 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,191 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,193 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,195 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,196 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,198 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,200 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,202 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,204 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,206 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,208 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,210 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,212 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,214 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,216 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,218 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,220 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,221 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,223 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,225 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,227 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,228 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,230 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,232 copying build/lib/lm_eval/tasks/arabicmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,234 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,235 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,237 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,239 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,241 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,243 copying build/lib/lm_eval/tasks/arabicmmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,245 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,247 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,248 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,250 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,252 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,254 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,256 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,257 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,259 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,261 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,263 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,265 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,266 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,268 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,270 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,272 copying build/lib/lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,273 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,275 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,277 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,279 copying build/lib/lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,281 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:40:04,284 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals 2026-09-01T00:40:04,285 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:40:04,286 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:40:04,288 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:40:04,290 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:40:04,293 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/winogenerated 2026-09-01T00:40:04,294 copying build/lib/lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/winogenerated 2026-09-01T00:40:04,297 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,298 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,300 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,302 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,304 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,306 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,308 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,310 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,311 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,313 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,315 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,316 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,318 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,320 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,322 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,324 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,326 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,328 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,330 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,331 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,333 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,335 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,337 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,339 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,341 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,343 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,344 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,346 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,348 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,350 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,352 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,354 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,355 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,357 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,359 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,361 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,363 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,365 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,367 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,368 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,370 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,372 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,374 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,376 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,377 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,379 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,381 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,382 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,384 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,386 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,388 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,390 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:40:04,394 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,396 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,398 copying build/lib/lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,399 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,401 copying build/lib/lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,403 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,405 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,407 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,409 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,411 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,413 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,415 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,417 copying build/lib/lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,419 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,421 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,422 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,424 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,426 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,428 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,430 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,432 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,433 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,435 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,437 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,439 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,441 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,443 copying build/lib/lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,445 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,447 copying build/lib/lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,449 copying build/lib/lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,451 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,453 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,455 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,457 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,459 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,460 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,462 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,464 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,466 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,468 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,470 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,471 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,474 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,476 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,477 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,479 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,481 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,483 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,485 copying build/lib/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,487 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,489 copying build/lib/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,491 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,493 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,495 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,497 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,499 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,500 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,502 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,504 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,506 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,508 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,510 copying build/lib/lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,511 copying build/lib/lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,513 copying build/lib/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,515 copying build/lib/lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,517 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,519 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,521 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,523 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,525 copying build/lib/lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,527 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,529 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,531 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,533 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,535 copying build/lib/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,537 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,539 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,541 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,544 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,547 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,550 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,554 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,559 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,564 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,570 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,573 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,575 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,577 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,579 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,581 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,583 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,585 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,587 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,589 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,591 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,593 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,594 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,596 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,598 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,600 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,602 copying build/lib/lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,604 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,606 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,608 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,610 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,612 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,614 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,616 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,618 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,620 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,622 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,624 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,626 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,628 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,630 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,632 copying build/lib/lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,634 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,635 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,637 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,639 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,641 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,643 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,645 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,647 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,649 copying build/lib/lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,651 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,653 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,655 copying build/lib/lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,657 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,659 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,661 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,663 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,665 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,667 copying build/lib/lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,669 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,671 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,672 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,674 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:40:04,677 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue 2026-09-01T00:40:04,678 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/boolq 2026-09-01T00:40:04,680 copying build/lib/lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-09-01T00:40:04,682 copying build/lib/lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-09-01T00:40:04,684 copying build/lib/lm_eval/tasks/super_glue/boolq/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-09-01T00:40:04,686 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/rte 2026-09-01T00:40:04,687 copying build/lib/lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2026-09-01T00:40:04,690 copying build/lib/lm_eval/tasks/super_glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2026-09-01T00:40:04,693 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wsc 2026-09-01T00:40:04,694 copying build/lib/lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-09-01T00:40:04,696 copying build/lib/lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-09-01T00:40:04,698 copying build/lib/lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-09-01T00:40:04,700 copying build/lib/lm_eval/tasks/super_glue/wsc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-09-01T00:40:04,703 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/cb 2026-09-01T00:40:04,704 copying build/lib/lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-09-01T00:40:04,706 copying build/lib/lm_eval/tasks/super_glue/cb/aggregate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-09-01T00:40:04,708 copying build/lib/lm_eval/tasks/super_glue/cb/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-09-01T00:40:04,710 copying build/lib/lm_eval/tasks/super_glue/cb/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-09-01T00:40:04,713 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wic 2026-09-01T00:40:04,714 copying build/lib/lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2026-09-01T00:40:04,717 copying build/lib/lm_eval/tasks/super_glue/wic/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2026-09-01T00:40:04,722 copying build/lib/lm_eval/tasks/super_glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue 2026-09-01T00:40:04,728 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/record 2026-09-01T00:40:04,729 copying build/lib/lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-09-01T00:40:04,732 copying build/lib/lm_eval/tasks/super_glue/record/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-09-01T00:40:04,734 copying build/lib/lm_eval/tasks/super_glue/record/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-09-01T00:40:04,738 copying build/lib/lm_eval/tasks/super_glue/record/util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-09-01T00:40:04,741 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/multirc 2026-09-01T00:40:04,742 copying build/lib/lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-09-01T00:40:04,746 copying build/lib/lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-09-01T00:40:04,756 copying build/lib/lm_eval/tasks/super_glue/multirc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-09-01T00:40:04,759 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/copa 2026-09-01T00:40:04,761 copying build/lib/lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-09-01T00:40:04,763 copying build/lib/lm_eval/tasks/super_glue/copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-09-01T00:40:04,766 copying build/lib/lm_eval/tasks/super_glue/copa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-09-01T00:40:04,769 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toxigen 2026-09-01T00:40:04,770 copying build/lib/lm_eval/tasks/toxigen/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-09-01T00:40:04,772 copying build/lib/lm_eval/tasks/toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-09-01T00:40:04,775 copying build/lib/lm_eval/tasks/toxigen/toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-09-01T00:40:04,778 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_reading 2026-09-01T00:40:04,779 copying build/lib/lm_eval/tasks/eus_reading/eus_reading.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-09-01T00:40:04,781 copying build/lib/lm_eval/tasks/eus_reading/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-09-01T00:40:04,784 copying build/lib/lm_eval/tasks/eus_reading/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-09-01T00:40:04,788 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ceval 2026-09-01T00:40:04,789 copying build/lib/lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,791 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,794 copying build/lib/lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,796 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,798 copying build/lib/lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,800 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,802 copying build/lib/lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,805 copying build/lib/lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,807 copying build/lib/lm_eval/tasks/ceval/_ceval-valid.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,809 copying build/lib/lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,811 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,813 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,815 copying build/lib/lm_eval/tasks/ceval/_default_ceval_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,817 copying build/lib/lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,820 copying build/lib/lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,822 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,824 copying build/lib/lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,826 copying build/lib/lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,828 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,830 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,832 copying build/lib/lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,834 copying build/lib/lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,837 copying build/lib/lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,839 copying build/lib/lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,841 copying build/lib/lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,843 copying build/lib/lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,846 copying build/lib/lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,848 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,850 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,852 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,854 copying build/lib/lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,856 copying build/lib/lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,858 copying build/lib/lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,860 copying build/lib/lm_eval/tasks/ceval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,862 copying build/lib/lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,863 copying build/lib/lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,865 copying build/lib/lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,867 copying build/lib/lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,869 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,870 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,872 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,874 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,875 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,877 copying build/lib/lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,879 copying build/lib/lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,881 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,882 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,884 copying build/lib/lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,886 copying build/lib/lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,888 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,889 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,891 copying build/lib/lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,893 copying build/lib/lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,895 copying build/lib/lm_eval/tasks/ceval/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,897 copying build/lib/lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,899 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:40:04,901 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mela 2026-09-01T00:40:04,902 copying build/lib/lm_eval/tasks/mela/mela_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,904 copying build/lib/lm_eval/tasks/mela/mela_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,906 copying build/lib/lm_eval/tasks/mela/mela_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,908 copying build/lib/lm_eval/tasks/mela/mela_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,909 copying build/lib/lm_eval/tasks/mela/_mela.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,911 copying build/lib/lm_eval/tasks/mela/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,913 copying build/lib/lm_eval/tasks/mela/mela_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,915 copying build/lib/lm_eval/tasks/mela/mela_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,916 copying build/lib/lm_eval/tasks/mela/mela_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,918 copying build/lib/lm_eval/tasks/mela/mela_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,920 copying build/lib/lm_eval/tasks/mela/mela_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,922 copying build/lib/lm_eval/tasks/mela/mela_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:40:04,924 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aexams 2026-09-01T00:40:04,925 copying build/lib/lm_eval/tasks/aexams/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:40:04,927 copying build/lib/lm_eval/tasks/aexams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:40:04,929 copying build/lib/lm_eval/tasks/aexams/aexams_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:40:04,931 copying build/lib/lm_eval/tasks/aexams/aexams_Science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:40:04,932 copying build/lib/lm_eval/tasks/aexams/_aexams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:40:04,934 copying build/lib/lm_eval/tasks/aexams/aexams_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:40:04,936 copying build/lib/lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:40:04,938 copying build/lib/lm_eval/tasks/aexams/aexams_Social.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:40:04,941 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc_mt 2026-09-01T00:40:04,942 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,944 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,946 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,948 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,950 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,952 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,953 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,955 copying build/lib/lm_eval/tasks/arc_mt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,957 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,959 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,961 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,963 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,965 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:40:04,967 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/triviaqa 2026-09-01T00:40:04,968 copying build/lib/lm_eval/tasks/triviaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2026-09-01T00:40:04,970 copying build/lib/lm_eval/tasks/triviaqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2026-09-01T00:40:04,972 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/haerae 2026-09-01T00:40:04,973 copying build/lib/lm_eval/tasks/haerae/haerae_lw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:40:04,975 copying build/lib/lm_eval/tasks/haerae/_default_haerae_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:40:04,977 copying build/lib/lm_eval/tasks/haerae/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:40:04,979 copying build/lib/lm_eval/tasks/haerae/haerae_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:40:04,981 copying build/lib/lm_eval/tasks/haerae/haerae_gk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:40:04,983 copying build/lib/lm_eval/tasks/haerae/haerae_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:40:04,985 copying build/lib/lm_eval/tasks/haerae/_haerae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:40:04,987 copying build/lib/lm_eval/tasks/haerae/haerae_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:40:04,989 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k 2026-09-01T00:40:04,990 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:40:04,992 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:40:04,994 copying build/lib/lm_eval/tasks/gsm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:40:04,997 copying build/lib/lm_eval/tasks/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:40:04,999 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:40:05,001 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:40:05,003 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qa4mre 2026-09-01T00:40:05,004 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:40:05,006 copying build/lib/lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:40:05,008 copying build/lib/lm_eval/tasks/qa4mre/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:40:05,010 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:40:05,012 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:40:05,014 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basqueglue 2026-09-01T00:40:05,015 copying build/lib/lm_eval/tasks/basqueglue/bhtc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:40:05,017 copying build/lib/lm_eval/tasks/basqueglue/bec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:40:05,019 copying build/lib/lm_eval/tasks/basqueglue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:40:05,021 copying build/lib/lm_eval/tasks/basqueglue/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:40:05,023 copying build/lib/lm_eval/tasks/basqueglue/wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:40:05,025 copying build/lib/lm_eval/tasks/basqueglue/coref.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:40:05,026 copying build/lib/lm_eval/tasks/basqueglue/vaxx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:40:05,028 copying build/lib/lm_eval/tasks/basqueglue/qnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:40:05,030 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/coqa 2026-09-01T00:40:05,031 copying build/lib/lm_eval/tasks/coqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-09-01T00:40:05,033 copying build/lib/lm_eval/tasks/coqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-09-01T00:40:05,035 copying build/lib/lm_eval/tasks/coqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-09-01T00:40:05,038 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu 2026-09-01T00:40:05,039 copying build/lib/lm_eval/tasks/afrimmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-09-01T00:40:05,041 copying build/lib/lm_eval/tasks/afrimmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-09-01T00:40:05,043 copying build/lib/lm_eval/tasks/afrimmlu/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-09-01T00:40:05,044 copying build/lib/lm_eval/tasks/afrimmlu/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-09-01T00:40:05,047 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate 2026-09-01T00:40:05,048 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2026-09-01T00:40:05,050 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,051 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,053 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,055 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,057 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,059 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,061 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,063 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,064 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,066 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,068 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,070 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,072 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,073 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,075 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,077 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,078 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,080 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,082 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,083 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:40:05,086 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,087 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,089 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,091 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,093 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,094 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,096 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,098 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,100 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,102 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,104 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,106 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,108 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,110 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,112 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,114 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,115 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,117 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,119 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,121 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:40:05,123 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,124 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,126 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,128 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,130 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,132 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,133 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,135 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,137 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,139 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,141 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,142 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,144 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,146 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,148 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,150 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,151 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,153 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,155 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,156 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:40:05,159 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,160 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,162 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,164 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,166 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,167 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,169 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,171 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,173 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,175 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,177 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,179 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,180 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,182 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,184 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,186 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,188 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,190 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,192 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,194 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:40:05,196 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,197 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,199 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,201 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,203 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,204 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,206 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,208 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,210 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,212 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,214 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,217 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,219 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,221 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,222 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,224 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,226 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,228 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,230 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,232 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:40:05,235 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct 2026-09-01T00:40:05,236 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2026-09-01T00:40:05,239 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,240 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,242 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,243 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,246 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,248 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,249 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,251 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,254 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,256 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,258 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,260 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,262 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,263 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,265 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,267 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,269 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,271 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,273 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,275 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,277 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:40:05,280 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,281 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,283 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,285 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,286 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,288 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,290 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,292 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,294 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,296 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,298 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,300 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,302 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,304 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,305 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,307 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,309 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,311 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,313 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,315 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,317 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:40:05,319 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,320 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,322 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,324 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,326 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,328 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,329 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,331 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,333 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,335 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,337 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,339 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,340 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,342 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,344 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,346 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,347 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,349 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,351 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,353 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,355 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:40:05,357 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,359 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,361 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,363 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,365 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,367 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,368 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,370 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,372 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,374 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,376 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,377 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,379 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,381 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,383 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,385 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,387 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,389 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,390 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,392 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,394 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:40:05,397 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,398 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,400 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,402 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,404 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,406 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,408 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,410 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,411 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,413 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,415 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,417 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,419 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,420 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,422 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,424 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,426 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,427 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,429 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,431 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,433 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:40:05,436 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/headqa 2026-09-01T00:40:05,437 copying build/lib/lm_eval/tasks/headqa/headqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-09-01T00:40:05,439 copying build/lib/lm_eval/tasks/headqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-09-01T00:40:05,441 copying build/lib/lm_eval/tasks/headqa/headqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-09-01T00:40:05,444 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval 2026-09-01T00:40:05,445 copying build/lib/lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:40:05,447 copying build/lib/lm_eval/tasks/humaneval/humaneval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:40:05,449 copying build/lib/lm_eval/tasks/humaneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:40:05,451 copying build/lib/lm_eval/tasks/humaneval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:40:05,453 copying build/lib/lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:40:05,455 copying build/lib/lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:40:05,457 copying build/lib/lm_eval/tasks/humaneval/humaneval_64.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:40:05,459 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:40:05,460 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:40:05,462 copying build/lib/lm_eval/tasks/gsm8k_platinum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:40:05,464 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:40:05,465 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:40:05,467 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:40:05,469 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:40:05,471 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score 2026-09-01T00:40:05,472 copying build/lib/lm_eval/tasks/score/score_robustness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:40:05,475 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,476 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,478 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,480 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,482 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,484 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,486 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,488 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,490 copying build/lib/lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,491 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,493 copying build/lib/lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,496 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,498 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,500 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,502 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,504 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,506 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,507 copying build/lib/lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,509 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,511 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,513 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,514 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,516 copying build/lib/lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,518 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,520 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,522 copying build/lib/lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,524 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,526 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:40:05,528 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/math 2026-09-01T00:40:05,529 copying build/lib/lm_eval/tasks/score/math/score_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,531 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,533 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,535 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,537 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,539 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,541 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,542 copying build/lib/lm_eval/tasks/score/math/math_grader.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,545 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,547 copying build/lib/lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,549 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,551 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,553 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,555 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,556 copying build/lib/lm_eval/tasks/score/math/utils_math.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,558 copying build/lib/lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,560 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,562 copying build/lib/lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,564 copying build/lib/lm_eval/tasks/score/math/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,566 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,568 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:40:05,569 copying build/lib/lm_eval/tasks/score/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:40:05,572 copying build/lib/lm_eval/tasks/score/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:40:05,574 copying build/lib/lm_eval/tasks/score/NON_GREEDY.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:40:05,576 copying build/lib/lm_eval/tasks/score/non_greedy_summarizer.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:40:05,578 copying build/lib/lm_eval/tasks/score/non_greedy.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:40:05,581 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:40:05,582 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:40:05,584 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:40:05,586 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:40:05,588 copying build/lib/lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:40:05,590 copying build/lib/lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:40:05,593 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,594 copying build/lib/lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,597 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,598 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,599 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,601 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,603 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,605 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,607 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,608 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,610 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,612 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,613 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,615 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,617 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,619 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,621 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,622 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,624 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,626 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,628 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,630 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:40:05,633 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:40:05,634 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:40:05,636 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:40:05,637 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:40:05,639 copying build/lib/lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,641 copying build/lib/lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,643 copying build/lib/lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,645 copying build/lib/lm_eval/tasks/spanish_bench/copa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,647 copying build/lib/lm_eval/tasks/spanish_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,649 copying build/lib/lm_eval/tasks/spanish_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,650 copying build/lib/lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,652 copying build/lib/lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,654 copying build/lib/lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,655 copying build/lib/lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,657 copying build/lib/lm_eval/tasks/spanish_bench/escola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:40:05,659 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/careqa 2026-09-01T00:40:05,660 copying build/lib/lm_eval/tasks/careqa/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:40:05,662 copying build/lib/lm_eval/tasks/careqa/careqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:40:05,664 copying build/lib/lm_eval/tasks/careqa/careqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:40:05,666 copying build/lib/lm_eval/tasks/careqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:40:05,668 copying build/lib/lm_eval/tasks/careqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:40:05,670 copying build/lib/lm_eval/tasks/careqa/careqa_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:40:05,672 copying build/lib/lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:40:05,673 copying build/lib/lm_eval/tasks/careqa/utils_open.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:40:05,676 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/piqa 2026-09-01T00:40:05,677 copying build/lib/lm_eval/tasks/piqa/piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2026-09-01T00:40:05,679 copying build/lib/lm_eval/tasks/piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2026-09-01T00:40:05,682 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa 2026-09-01T00:40:05,685 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,687 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,689 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,690 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,692 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/_global_piqa_parallel_generation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,695 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,697 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,699 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,701 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,702 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,704 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,706 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,708 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,709 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,711 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/eus_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,713 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,715 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,717 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tel_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,719 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,721 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,723 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,725 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,727 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,728 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,730 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,733 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mag_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,734 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,736 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,738 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,740 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,742 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,744 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/srp_latn_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,746 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/xho_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,748 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,749 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,751 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,753 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,755 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,756 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bgc_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,758 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,760 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,762 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,764 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,766 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,767 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,769 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,771 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,773 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,775 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,777 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,779 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,781 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,782 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,784 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,786 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,788 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,790 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,791 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,793 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,795 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,797 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,798 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,800 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,802 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,804 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,806 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,808 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bra_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,810 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,812 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,813 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bcc_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,815 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/swv_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,817 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,819 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,821 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/plt_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,823 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ceb_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,825 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,827 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,829 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,831 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,832 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,834 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,836 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,838 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,840 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,841 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ory_orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,843 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,845 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,847 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,849 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,851 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,853 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,855 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,857 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,859 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,861 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,863 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,865 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,866 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,868 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/dan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,870 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,872 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,874 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,876 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,877 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bxr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,879 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,881 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/cls_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,883 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,885 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,887 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,889 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,890 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,892 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slv_latn_prle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,894 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,896 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,898 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,900 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,902 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,904 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,906 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,908 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,910 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,912 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,914 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,915 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,917 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,919 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/sin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,921 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,923 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,925 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,927 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,929 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,931 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,932 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,934 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,936 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ilo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:40:05,938 copying build/lib/lm_eval/tasks/global_piqa/_global_piqa_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa 2026-09-01T00:40:05,943 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,944 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,946 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,948 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,950 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,952 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,954 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,955 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ckb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,957 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,959 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,961 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,963 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,965 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mni_mtei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,966 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,968 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kaz_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,970 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,972 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/eus_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,974 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,976 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,978 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tel_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,980 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,982 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,983 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,985 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,987 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,989 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,991 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,993 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,995 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,997 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:05,998 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,000 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,002 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,004 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,006 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,007 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bsk_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,009 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,011 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,013 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,015 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bgc_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,017 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,019 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,021 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,023 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,024 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,026 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,028 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/luo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,030 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,032 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,034 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/asm_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,036 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,038 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,040 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,041 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,043 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,045 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,047 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,049 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,050 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,052 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,054 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,056 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/_global_piqa_nonparallel_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,058 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,060 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,062 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,064 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,066 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,068 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/sun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,070 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,072 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,074 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,076 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bra_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,078 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,080 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,081 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bcc_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,083 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/swv_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,085 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,087 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,089 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/plt_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,091 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,092 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,094 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,096 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,098 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,100 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,102 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,103 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,105 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,107 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ory_orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,109 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,111 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,113 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,115 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,117 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,119 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,121 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,122 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,124 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,126 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,128 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/dje_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,130 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,132 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,134 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,136 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/dan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,137 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,139 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,141 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,143 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,145 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,147 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/cls_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,149 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/btx_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,150 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,152 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,154 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,156 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,158 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,160 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_prle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,162 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bos_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,164 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,166 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,168 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,170 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,171 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,173 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,176 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,178 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,180 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,182 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,184 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,186 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,187 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,189 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/sin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,191 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,193 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,195 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,197 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,199 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,201 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,203 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,205 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:40:06,207 copying build/lib/lm_eval/tasks/global_piqa/_global_piqa_generation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa 2026-09-01T00:40:06,209 copying build/lib/lm_eval/tasks/global_piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa 2026-09-01T00:40:06,214 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,216 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,217 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,219 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,221 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,223 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,225 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,227 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,229 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,230 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,232 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,234 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,235 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,237 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/eus_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,239 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,241 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,243 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tel_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,245 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,247 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,248 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,250 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,252 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,254 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,256 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,258 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mag_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,259 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,261 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,263 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,265 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,267 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,269 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/srp_latn_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,271 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/xho_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,272 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,274 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,276 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,278 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,280 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,282 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bgc_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,283 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,285 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,287 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,289 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,291 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,293 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,295 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,297 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,299 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,301 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,302 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,304 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,306 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,308 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,310 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,312 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,314 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,316 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,317 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,319 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,321 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,323 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,325 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,327 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,329 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,331 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,333 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,335 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bra_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,337 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,339 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,340 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bcc_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,342 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/swv_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,344 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,346 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,348 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/plt_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,350 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ceb_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,352 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,354 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,356 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,358 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,360 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,361 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,363 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,365 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,367 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,369 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ory_orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,371 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,373 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,375 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,377 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,379 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,381 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,383 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,384 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,386 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,388 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,390 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,392 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,394 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,396 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/dan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,398 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,399 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,401 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,403 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,405 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bxr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,407 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,409 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/cls_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,411 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,413 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,416 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,418 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,420 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,422 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_prle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,424 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,425 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,427 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,429 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,431 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,433 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,435 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,436 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,438 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,440 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,442 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,444 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,446 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,448 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/sin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,450 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,452 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,454 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,456 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,458 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,460 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,462 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/_global_piqa_parallel_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,465 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,467 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,468 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ilo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:40:06,473 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,475 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,477 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,479 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,480 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,482 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,484 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,486 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ckb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,488 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,490 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,492 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,494 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,496 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mni_mtei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,498 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,501 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kaz_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,503 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,505 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/eus_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,507 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,509 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,511 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tel_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,513 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,515 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,517 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,519 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,520 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,522 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,524 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,526 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,528 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,530 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,532 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,533 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,535 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,537 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,539 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,541 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bsk_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,543 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,545 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,547 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,549 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bgc_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,551 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,553 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,555 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,557 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,559 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,561 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,563 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/luo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,565 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,567 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,568 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/asm_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,570 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,572 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,574 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,576 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,578 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,580 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,582 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,584 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,586 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,588 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,590 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,592 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,594 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,596 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,598 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/_global_piqa_nonparallel_generation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,601 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,603 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,605 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/sun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,606 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,608 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,610 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,612 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bra_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,614 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,616 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,618 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bcc_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,619 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/swv_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,621 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,623 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,625 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/plt_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,627 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,629 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,631 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,632 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,634 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,636 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,638 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,640 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,642 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,644 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ory_orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,645 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,647 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,649 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,651 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,652 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,654 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,656 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,658 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,660 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,661 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,663 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/dje_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,665 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,667 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,669 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,671 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/dan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,673 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,675 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,676 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,678 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,680 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,682 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/cls_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,684 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/btx_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,686 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,687 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,689 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,691 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,693 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,695 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_prle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,697 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bos_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,699 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,701 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,703 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,704 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,706 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,708 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,710 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,712 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,714 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,716 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,718 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,720 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,722 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,724 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/sin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,726 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,728 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,730 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,732 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,733 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,736 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,738 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,739 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:40:06,742 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/drop 2026-09-01T00:40:06,743 copying build/lib/lm_eval/tasks/drop/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-09-01T00:40:06,746 copying build/lib/lm_eval/tasks/drop/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-09-01T00:40:06,748 copying build/lib/lm_eval/tasks/drop/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-09-01T00:40:06,750 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/storycloze 2026-09-01T00:40:06,751 copying build/lib/lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-09-01T00:40:06,753 copying build/lib/lm_eval/tasks/storycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-09-01T00:40:06,755 copying build/lib/lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-09-01T00:40:06,758 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/nq_open 2026-09-01T00:40:06,759 copying build/lib/lm_eval/tasks/nq_open/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2026-09-01T00:40:06,761 copying build/lib/lm_eval/tasks/nq_open/nq_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2026-09-01T00:40:06,763 copying build/lib/lm_eval/tasks/_factory.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:40:06,766 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/indicparam 2026-09-01T00:40:06,768 copying build/lib/lm_eval/tasks/indicparam/indicparam_oriya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,770 copying build/lib/lm_eval/tasks/indicparam/indicparam_rajasthani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,772 copying build/lib/lm_eval/tasks/indicparam/_indicparam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,773 copying build/lib/lm_eval/tasks/indicparam/indicparam_gujarati.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,775 copying build/lib/lm_eval/tasks/indicparam/indicparam_sanskrit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,777 copying build/lib/lm_eval/tasks/indicparam/indicparam_dogri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,779 copying build/lib/lm_eval/tasks/indicparam/indicparam_santali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,781 copying build/lib/lm_eval/tasks/indicparam/indicparam_sanskrit_mix.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,783 copying build/lib/lm_eval/tasks/indicparam/indicparam_maithili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,785 copying build/lib/lm_eval/tasks/indicparam/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,787 copying build/lib/lm_eval/tasks/indicparam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,789 copying build/lib/lm_eval/tasks/indicparam/indicparam_konkani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,790 copying build/lib/lm_eval/tasks/indicparam/indicparam_bodo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,792 copying build/lib/lm_eval/tasks/indicparam/_default_indicparam_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,794 copying build/lib/lm_eval/tasks/indicparam/indicparam_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,796 copying build/lib/lm_eval/tasks/indicparam/indicparam_marathi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:40:06,799 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,800 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,802 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_javascript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,804 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_biorxiv_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,806 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,808 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,810 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,812 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_nonenglish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,814 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_bbc_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,816 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_markdown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,818 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_nonenglish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,820 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_cpp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,821 copying build/lib/lm_eval/tasks/uncheatable_eval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,823 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_python.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,825 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,827 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,829 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,831 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,832 copying build/lib/lm_eval/tasks/uncheatable_eval/_uncheatable_eval_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,834 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:40:06,837 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:40:06,838 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:40:06,840 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:40:06,843 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,844 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,846 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,848 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,850 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,852 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,854 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,856 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,858 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,860 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,861 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,863 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,865 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,867 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,869 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,871 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,872 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,874 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,876 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,878 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,879 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,881 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,883 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,885 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,887 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,889 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,891 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,892 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,894 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,896 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,898 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,900 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,902 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,904 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,906 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,908 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,909 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,911 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,913 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,915 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,917 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,918 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,920 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,922 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,924 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,926 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,928 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,929 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,931 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,933 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,935 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,937 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,939 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,941 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,942 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,944 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,946 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,948 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,949 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,951 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:40:06,954 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:40:06,955 copying build/lib/lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:40:06,957 copying build/lib/lm_eval/tasks/mediqa_qa2019/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:40:06,959 copying build/lib/lm_eval/tasks/mediqa_qa2019/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:40:06,961 copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:40:06,962 copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:40:06,965 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/webqs 2026-09-01T00:40:06,966 copying build/lib/lm_eval/tasks/webqs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-09-01T00:40:06,968 copying build/lib/lm_eval/tasks/webqs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-09-01T00:40:06,970 copying build/lib/lm_eval/tasks/webqs/webqs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-09-01T00:40:06,973 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm_plus 2026-09-01T00:40:06,975 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-09-01T00:40:06,977 copying build/lib/lm_eval/tasks/gsm_plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-09-01T00:40:06,980 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-09-01T00:40:06,983 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa2 2026-09-01T00:40:06,984 copying build/lib/lm_eval/tasks/logiqa2/logieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-09-01T00:40:06,987 copying build/lib/lm_eval/tasks/logiqa2/logiqa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-09-01T00:40:06,989 copying build/lib/lm_eval/tasks/logiqa2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-09-01T00:40:06,991 copying build/lib/lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-09-01T00:40:06,995 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench 2026-09-01T00:40:06,997 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr 2026-09-01T00:40:06,998 copying build/lib/lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-09-01T00:40:07,001 copying build/lib/lm_eval/tasks/afrobench/adr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-09-01T00:40:07,003 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:40:07,005 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:40:07,007 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:40:07,009 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:40:07,011 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:40:07,014 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:40:07,016 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:40:07,019 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:40:07,020 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:40:07,022 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:40:07,025 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:40:07,027 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:40:07,029 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:40:07,031 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:40:07,034 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:40:07,035 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:40:07,038 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:40:07,040 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:40:07,042 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:40:07,044 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:40:07,047 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:40:07,049 copying build/lib/lm_eval/tasks/afrobench/adr/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-09-01T00:40:07,052 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:40:07,054 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:40:07,056 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:40:07,058 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:40:07,060 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:40:07,063 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:40:07,065 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:40:07,068 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:40:07,069 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:40:07,071 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:40:07,073 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:40:07,075 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:40:07,076 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:40:07,078 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:40:07,081 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:40:07,082 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:40:07,084 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:40:07,087 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,088 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,090 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,092 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,093 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,095 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,097 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,099 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,101 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,103 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:40:07,106 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,107 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,109 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,111 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,113 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,114 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,116 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,118 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,120 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,122 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:40:07,124 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:40:07,126 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,128 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,130 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,132 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,133 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,135 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,137 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,139 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,141 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,143 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:40:07,146 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,147 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,149 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,151 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,153 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,154 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,156 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,158 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,160 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,162 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:40:07,164 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,166 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,168 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,170 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,171 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,173 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,175 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,177 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,179 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,181 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:40:07,183 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt 2026-09-01T00:40:07,184 copying build/lib/lm_eval/tasks/afrobench/salt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-09-01T00:40:07,187 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,188 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,190 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,192 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,193 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,195 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,197 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,199 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,201 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,202 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,204 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,206 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,208 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,210 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,211 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,213 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:40:07,216 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,217 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,219 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,221 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,223 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,225 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,227 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,229 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,231 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,232 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,234 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,236 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,238 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,239 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,241 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,243 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:40:07,245 copying build/lib/lm_eval/tasks/afrobench/salt/salt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-09-01T00:40:07,246 copying build/lib/lm_eval/tasks/afrobench/salt/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-09-01T00:40:07,249 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,250 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,252 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,254 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,256 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,257 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,259 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,261 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,263 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,265 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,266 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,268 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,270 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,272 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,274 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,276 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:40:07,278 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele 2026-09-01T00:40:07,279 copying build/lib/lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-09-01T00:40:07,281 copying build/lib/lm_eval/tasks/afrobench/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-09-01T00:40:07,284 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,285 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,287 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,289 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,291 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,292 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,294 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,296 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,298 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,299 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,301 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,303 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,305 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,307 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,308 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,310 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,312 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,314 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,316 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,318 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,319 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,321 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,323 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,324 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,326 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,328 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,330 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,331 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,333 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,335 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,337 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,338 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,340 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:40:07,343 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,344 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,346 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,348 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,350 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,352 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,354 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,356 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,357 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,359 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,361 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,363 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,364 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,366 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,368 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,370 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,371 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,373 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,375 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,377 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,379 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,380 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,382 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,384 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,386 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,387 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,389 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,391 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,393 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,395 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,396 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,398 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,400 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:40:07,402 copying build/lib/lm_eval/tasks/afrobench/belebele/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-09-01T00:40:07,405 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,406 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,408 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,410 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,411 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,413 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,415 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,417 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,419 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,421 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,422 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,424 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,426 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,428 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,430 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,432 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,434 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,436 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,437 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,439 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,441 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,443 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,445 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,447 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,448 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,450 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,452 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,454 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,456 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,457 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,459 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,461 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,463 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:40:07,466 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,467 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,469 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,471 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,473 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,475 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,477 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,479 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,481 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,483 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,485 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,487 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,489 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,490 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,492 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,494 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,496 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,498 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,500 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,502 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,503 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,505 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,507 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,509 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,511 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,513 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,515 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,517 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,519 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,521 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,522 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,525 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,527 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:40:07,530 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,531 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,533 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,535 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,537 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,538 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,540 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,542 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,544 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,546 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,548 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,550 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,552 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,553 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,555 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,557 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,559 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,561 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,563 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,564 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,566 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,568 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,570 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,572 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,574 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,576 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,578 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,579 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,581 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,583 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,585 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,586 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,588 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:40:07,591 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:40:07,592 copying build/lib/lm_eval/tasks/afrobench/masakhapos/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:40:07,594 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,595 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,597 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,599 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,601 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,603 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,605 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,607 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,609 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,611 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,614 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,616 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,618 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,620 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,622 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,624 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,625 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,627 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,629 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,631 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,633 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,635 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,637 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:40:07,639 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,640 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,642 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,644 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,646 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,649 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,651 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,653 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,655 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,657 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,659 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,661 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,663 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,665 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,667 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,668 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,670 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,672 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,674 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,676 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,678 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,679 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,681 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:40:07,683 copying build/lib/lm_eval/tasks/afrobench/masakhapos/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:40:07,686 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,687 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,689 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,691 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,693 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,695 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,697 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,699 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,701 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,703 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,705 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,707 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,709 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,710 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,712 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,714 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,716 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,718 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,720 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,722 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,723 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,725 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,727 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:40:07,729 copying build/lib/lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:40:07,732 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,733 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,736 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,737 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,740 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,742 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,743 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,746 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,747 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,749 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,751 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,753 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,755 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,757 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,759 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,761 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,762 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,764 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,766 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,768 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,770 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,772 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,774 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:40:07,776 copying build/lib/lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:40:07,780 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,781 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,783 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,786 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,788 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,790 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,793 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,795 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,797 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,799 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,802 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,804 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,806 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,808 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,810 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,813 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,815 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,817 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,820 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,822 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,824 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,827 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,829 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:40:07,832 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:40:07,833 copying build/lib/lm_eval/tasks/afrobench/injongointent/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-09-01T00:40:07,837 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,838 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,841 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,843 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,846 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,848 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,850 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,852 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,854 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,857 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,859 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,861 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,863 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,866 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,868 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,870 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,872 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,875 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,877 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,879 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:40:07,880 copying build/lib/lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-09-01T00:40:07,883 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,884 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,887 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,889 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,891 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,892 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,894 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,896 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,898 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,899 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,901 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,903 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,905 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,907 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,908 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,910 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,912 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,914 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,916 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,918 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:40:07,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,922 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,924 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,926 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,927 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,929 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,931 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,933 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,935 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,937 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,939 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,940 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,942 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,944 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,946 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,948 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,950 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,951 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,953 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,955 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:40:07,957 copying build/lib/lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-09-01T00:40:07,960 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,961 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,963 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,965 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,967 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,969 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,971 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,972 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,974 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,976 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,978 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,980 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,982 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,983 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,985 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,987 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,989 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,990 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,992 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,994 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:40:07,997 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:07,998 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,000 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,002 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,003 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,005 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,007 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,009 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,011 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,013 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,015 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,017 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,019 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,021 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,023 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,024 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,026 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,028 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,030 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,032 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:40:08,035 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:40:08,036 copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:40:08,038 copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:40:08,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:40:08,042 copying build/lib/lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:40:08,044 copying build/lib/lm_eval/tasks/afrobench/masakhanews/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:40:08,047 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,048 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,050 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,052 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,054 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,056 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,058 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,060 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,062 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,063 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,065 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,067 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,069 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,071 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,073 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,075 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,077 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,079 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,080 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:40:08,083 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,084 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,086 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,088 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,090 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,092 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,094 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,096 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,098 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,100 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,102 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,103 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,105 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,107 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,109 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,111 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,113 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,115 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,116 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:40:08,118 copying build/lib/lm_eval/tasks/afrobench/masakhanews/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:40:08,121 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,123 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,125 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,127 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,129 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,131 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,133 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,135 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,137 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,139 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,141 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,142 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,144 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,146 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,148 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,150 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,152 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,153 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,155 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:40:08,158 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,159 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,162 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,164 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,166 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,168 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,170 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,172 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,174 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,176 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,178 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,180 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,182 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,184 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,186 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,188 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,190 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,192 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,194 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:40:08,196 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,197 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,199 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,201 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,203 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,205 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,207 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,209 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,211 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,213 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,215 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,217 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,219 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,221 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,223 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,224 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,226 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,228 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,230 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:40:08,233 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:40:08,234 copying build/lib/lm_eval/tasks/afrobench/afriqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-09-01T00:40:08,236 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,238 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,240 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,242 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,243 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,245 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,247 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,249 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,251 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,253 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,255 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,257 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:40:08,260 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,261 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,263 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,265 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,267 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,269 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,270 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,272 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,274 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,276 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,278 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,279 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:40:08,281 copying build/lib/lm_eval/tasks/afrobench/afriqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-09-01T00:40:08,284 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,285 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,287 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,289 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,291 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,292 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,294 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,296 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,298 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,300 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,302 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,304 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:40:08,305 copying build/lib/lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-09-01T00:40:08,308 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,309 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,311 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,313 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,315 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,317 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,319 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,320 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,322 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,324 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,326 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,328 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:40:08,330 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,331 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,333 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,335 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,337 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,339 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,341 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,344 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,346 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,348 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,350 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,352 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:40:08,354 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand 2026-09-01T00:40:08,356 copying build/lib/lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-09-01T00:40:08,358 copying build/lib/lm_eval/tasks/afrobench/mafand/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-09-01T00:40:08,362 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1 2026-09-01T00:40:08,365 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,367 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,369 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,371 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,373 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,375 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,377 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,379 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,381 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,383 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,385 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,387 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,389 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,391 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,393 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,396 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,398 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,399 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,401 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,403 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,406 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,408 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,410 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,412 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:40:08,414 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,416 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,418 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,419 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,421 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,423 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,425 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,427 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,429 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,431 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,433 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,435 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,437 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,439 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,441 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,443 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,445 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,447 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,449 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,451 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,453 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,455 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,457 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,459 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:40:08,461 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3 2026-09-01T00:40:08,463 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,464 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,467 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,469 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,471 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,473 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,475 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,477 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,478 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,480 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,482 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,484 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,486 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,488 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,490 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,492 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,494 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,496 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,498 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,500 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,502 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,504 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,506 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,508 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:40:08,511 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,512 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,514 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,516 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,518 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,520 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,522 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,525 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,527 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,529 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,531 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,533 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,535 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,537 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,539 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,541 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,542 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,544 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,547 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,549 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,551 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,552 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,554 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,556 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:40:08,558 copying build/lib/lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-09-01T00:40:08,561 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2 2026-09-01T00:40:08,563 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,565 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,567 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,569 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,571 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,573 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,575 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,577 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,579 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,581 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,583 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,586 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,588 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,591 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,593 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,596 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,599 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,601 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,604 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,606 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,608 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,611 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,613 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,616 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:40:08,619 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,621 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,623 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,626 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,628 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,630 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,632 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,635 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,637 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,639 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,642 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,644 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,647 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,649 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,652 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,654 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,657 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,659 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,661 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,664 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,666 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,668 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,671 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,673 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:40:08,676 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:40:08,678 copying build/lib/lm_eval/tasks/afrobench/afrisenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:40:08,681 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,682 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,684 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,686 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,688 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,690 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,692 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,694 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,697 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,699 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,701 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,702 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,704 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,706 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,708 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,710 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,712 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,714 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,716 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:40:08,719 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,720 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,722 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,724 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,726 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,728 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,730 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,732 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,734 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,736 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,738 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,740 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,742 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,744 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,746 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,748 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,750 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,752 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:40:08,754 copying build/lib/lm_eval/tasks/afrobench/afrisenti/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:40:08,757 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,758 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,760 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,762 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,764 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,766 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,768 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,770 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,772 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,774 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,776 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,778 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,780 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,782 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,784 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,786 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,788 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,790 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:40:08,792 copying build/lib/lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:40:08,794 copying build/lib/lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:40:08,797 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,798 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,800 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,802 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,805 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,807 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,809 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,810 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,812 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,814 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,816 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,818 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,820 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,822 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,824 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,826 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,828 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,830 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:40:08,832 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,833 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,835 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,837 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,839 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,841 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,843 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,845 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,847 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,849 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,851 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,853 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,855 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,857 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,859 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,860 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,862 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,864 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,866 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:40:08,868 copying build/lib/lm_eval/tasks/afrobench/afrobench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-09-01T00:40:08,871 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:40:08,872 copying build/lib/lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-09-01T00:40:08,874 copying build/lib/lm_eval/tasks/afrobench/ntrex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-09-01T00:40:08,876 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1 2026-09-01T00:40:08,878 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,880 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,882 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,884 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,886 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,888 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,890 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,892 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,894 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,896 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,897 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,899 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,901 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,903 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,905 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,907 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,909 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,911 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,913 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,915 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,917 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,919 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,921 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,923 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,925 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,927 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,929 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,931 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,933 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,935 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,937 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,938 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,940 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,942 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:40:08,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,946 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,948 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,950 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,952 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,954 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,956 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,957 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,959 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,961 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,963 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,965 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,967 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,969 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,971 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,972 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,974 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,976 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,978 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,979 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,981 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,983 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,985 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,987 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,989 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,991 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,993 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,995 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,997 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:08,999 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:09,001 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:09,002 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:09,004 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:09,006 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:40:09,009 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3 2026-09-01T00:40:09,011 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,012 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,014 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,016 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,018 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,019 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,021 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,023 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,025 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,027 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,029 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,031 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,032 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,034 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,036 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,038 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,039 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,041 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,043 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,044 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,046 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,048 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,050 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,051 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,053 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,055 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,057 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,059 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,061 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,063 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,065 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,067 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,069 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,071 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:40:09,074 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,075 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,077 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,079 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,080 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,082 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,084 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,086 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,088 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,090 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,092 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,094 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,095 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,097 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,099 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,101 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,103 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,105 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,107 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,109 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,111 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,113 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,115 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,117 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,119 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,120 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,122 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,124 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,126 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,128 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,130 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,132 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,133 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,135 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:40:09,137 copying build/lib/lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-09-01T00:40:09,140 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2 2026-09-01T00:40:09,142 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,143 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,146 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,148 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,150 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,152 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,154 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,156 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,158 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,160 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,161 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,163 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,165 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,167 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,169 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,171 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,173 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,175 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,177 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,179 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,181 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,183 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,185 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,187 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,189 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,190 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,192 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,194 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,196 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,197 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,199 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,201 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,203 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,205 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:40:09,208 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,209 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,211 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,213 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,215 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,217 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,219 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,221 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,223 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,225 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,226 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,228 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,230 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,232 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,234 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,236 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,238 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,240 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,242 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,244 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,246 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,248 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,250 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,252 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,254 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,256 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,258 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,260 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,262 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,264 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,266 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,268 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,270 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,272 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:40:09,274 copying build/lib/lm_eval/tasks/afrobench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-09-01T00:40:09,277 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:40:09,278 copying build/lib/lm_eval/tasks/afrobench/nollysenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:40:09,280 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:40:09,282 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:40:09,284 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:40:09,286 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:40:09,288 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:40:09,290 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:40:09,292 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:40:09,294 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:40:09,296 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:40:09,297 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:40:09,299 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:40:09,301 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:40:09,303 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:40:09,305 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:40:09,307 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:40:09,309 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:40:09,311 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:40:09,312 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:40:09,314 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:40:09,316 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:40:09,318 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:40:09,320 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:40:09,322 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:40:09,324 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:40:09,326 copying build/lib/lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:40:09,328 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:40:09,329 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:40:09,332 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:40:09,334 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:40:09,336 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:40:09,338 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:40:09,340 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:40:09,342 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:40:09,344 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:40:09,346 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:40:09,348 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:40:09,350 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:40:09,351 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:40:09,353 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:40:09,355 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:40:09,357 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:40:09,360 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores 2026-09-01T00:40:09,361 copying build/lib/lm_eval/tasks/afrobench/flores/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-09-01T00:40:09,363 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1 2026-09-01T00:40:09,366 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,368 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,370 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,372 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,374 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,376 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,378 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,380 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,382 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,383 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,385 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,388 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,389 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,391 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,393 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,395 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,397 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,399 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,400 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,402 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,404 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,406 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,408 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,410 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,412 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,414 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,416 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,418 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,419 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,421 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,423 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,425 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,427 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,429 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,431 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,433 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,434 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,436 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,438 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,440 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,442 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,444 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,446 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,448 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,449 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,451 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,453 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,455 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,457 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,459 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,461 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,462 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,464 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,466 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,468 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,470 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,472 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,473 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,475 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,477 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,479 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,481 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,483 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,485 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:40:09,488 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,489 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,491 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,493 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,495 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,497 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,499 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,501 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,503 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,505 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,506 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,508 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,510 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,512 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,514 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,516 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,518 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,520 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,521 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,523 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,526 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,528 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,530 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,532 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,533 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,535 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,537 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,539 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,541 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,543 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,545 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,546 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,548 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,550 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,552 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,554 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,556 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,558 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,561 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,562 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,565 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,567 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,569 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,571 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,573 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,575 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,577 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,579 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,581 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,582 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,584 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,586 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,588 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,590 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,592 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,594 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,596 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,598 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,600 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,602 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,604 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,606 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,608 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,609 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:40:09,611 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1 2026-09-01T00:40:09,614 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3 2026-09-01T00:40:09,616 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,618 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,620 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,622 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,623 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,626 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,627 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,629 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,632 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,634 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,636 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,638 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,640 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,642 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,644 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,646 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,648 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,649 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,651 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,653 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,655 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,657 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,659 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,661 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,663 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,665 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,667 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,669 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,670 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,672 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,674 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,676 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,678 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,680 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,682 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,684 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,686 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,688 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,689 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,691 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,693 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,695 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,697 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,699 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,701 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,703 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,705 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,707 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,709 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,711 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,713 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,714 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,716 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,718 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,720 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,722 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,724 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,725 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,727 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,729 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,731 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,733 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,735 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,737 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:40:09,740 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,741 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,743 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,745 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,747 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,749 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,751 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,753 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,754 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,756 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,758 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,760 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,762 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,764 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,766 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,767 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,769 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,771 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,773 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,775 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,777 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,779 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,781 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,783 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,785 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,787 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,789 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,791 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,793 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,795 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,797 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,798 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,800 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,802 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,804 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,806 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,808 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,810 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,812 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,814 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,816 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,818 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,820 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,821 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,823 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,825 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,827 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,829 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,831 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,832 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,834 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,836 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,838 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,840 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,841 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,843 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,845 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,847 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,849 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,851 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,853 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,855 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,857 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,859 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:40:09,861 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3 2026-09-01T00:40:09,863 copying build/lib/lm_eval/tasks/afrobench/flores/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-09-01T00:40:09,865 copying build/lib/lm_eval/tasks/afrobench/flores/flores.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-09-01T00:40:09,867 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2 2026-09-01T00:40:09,870 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,871 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,873 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,875 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,877 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,879 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,881 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,882 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,884 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,886 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,888 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,890 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,892 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,894 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,895 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,897 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,899 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,901 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,903 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,905 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,906 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,908 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,910 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,912 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,914 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,916 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,918 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,920 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,922 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,924 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,926 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,928 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,930 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,932 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,933 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,935 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,937 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,939 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,941 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,943 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,944 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,946 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,948 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,950 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,952 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,954 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,955 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,957 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,959 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,961 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,963 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,965 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,967 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,968 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,970 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,972 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,973 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,975 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,977 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,979 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,980 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,982 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,984 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,986 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:40:09,989 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:09,990 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:09,992 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:09,994 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:09,996 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:09,998 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,000 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,001 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,003 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,005 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,006 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,008 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,010 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,012 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,013 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,015 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,017 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,019 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,020 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,022 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,024 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,026 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,028 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,030 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,031 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,033 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,035 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,036 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,038 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,040 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,041 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,043 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,045 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,047 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,048 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,050 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,052 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,054 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,056 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,058 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,060 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,061 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,063 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,065 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,067 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,069 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,070 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,072 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,074 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,075 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,077 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,079 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,080 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,082 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,084 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,086 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,088 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,089 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,091 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,093 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,095 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,097 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,098 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,100 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:40:10,102 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2 2026-09-01T00:40:10,105 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:40:10,106 copying build/lib/lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-09-01T00:40:10,108 copying build/lib/lm_eval/tasks/afrobench/naijarc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-09-01T00:40:10,110 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:40:10,111 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:40:10,113 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:40:10,114 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:40:10,116 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:40:10,118 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:40:10,119 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:40:10,121 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:40:10,123 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:40:10,125 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:40:10,127 copying build/lib/lm_eval/tasks/afrobench/naijarc/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-09-01T00:40:10,129 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:40:10,130 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:40:10,132 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:40:10,134 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:40:10,136 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:40:10,138 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:40:10,139 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:40:10,141 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:40:10,142 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:40:10,144 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:40:10,146 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:40:10,147 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:40:10,149 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:40:10,150 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:40:10,152 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:40:10,154 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:40:10,155 copying build/lib/lm_eval/tasks/afrobench/masakhaner/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:40:10,158 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,159 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,161 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,162 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,164 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,166 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,168 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,169 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,171 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,173 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,174 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,177 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,179 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,180 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,182 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,184 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,186 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,188 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,189 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,191 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,193 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,194 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,196 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:40:10,198 copying build/lib/lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:40:10,200 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,201 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,203 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,205 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,207 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,208 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,210 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,212 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,214 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,216 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,218 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,220 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,222 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,223 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,225 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,227 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,229 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,230 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,232 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,234 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,235 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,237 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,239 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:40:10,241 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,242 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,245 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,247 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,249 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,250 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,252 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,254 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,256 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,258 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,260 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,262 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,264 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,266 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,268 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,269 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,271 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,273 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,275 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,277 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,278 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,280 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,282 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:40:10,284 copying build/lib/lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:40:10,286 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,288 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,290 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,291 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,293 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,295 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,297 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,299 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,301 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,303 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,305 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,307 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,309 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,311 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,313 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,314 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,316 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,318 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,320 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,322 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,323 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,325 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,327 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:40:10,330 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,331 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,333 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,335 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,337 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,339 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,341 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,343 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,345 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,347 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,349 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,351 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,353 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,355 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,357 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,358 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,360 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,362 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,364 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,366 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,368 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,369 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,371 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:40:10,374 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:40:10,375 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:40:10,377 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:40:10,379 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:40:10,380 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:40:10,382 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:40:10,384 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:40:10,386 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:40:10,389 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:40:10,390 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:40:10,391 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:40:10,393 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:40:10,395 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:40:10,397 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:40:10,399 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:40:10,400 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:40:10,403 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:40:10,404 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:40:10,406 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:40:10,408 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:40:10,410 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:40:10,412 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:40:10,414 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:40:10,415 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:40:10,418 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:40:10,419 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:40:10,421 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:40:10,423 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:40:10,425 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:40:10,427 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:40:10,428 copying build/lib/lm_eval/tasks/afrobench/xlsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-09-01T00:40:10,431 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,432 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,434 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,436 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,438 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,439 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,441 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,443 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,444 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,446 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,448 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,450 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,451 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,453 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,455 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:40:10,457 copying build/lib/lm_eval/tasks/afrobench/xlsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-09-01T00:40:10,459 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,460 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,462 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,464 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,466 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,468 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,470 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,472 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,474 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,476 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,478 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,480 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,481 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,483 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,485 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:40:10,487 copying build/lib/lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-09-01T00:40:10,489 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,490 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,492 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,494 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,496 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,498 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,500 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,502 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,504 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,506 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,508 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,509 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,511 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,513 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,515 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:40:10,518 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib 2026-09-01T00:40:10,519 copying build/lib/lm_eval/tasks/afrobench/sib/sib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-09-01T00:40:10,521 copying build/lib/lm_eval/tasks/afrobench/sib/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-09-01T00:40:10,524 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,525 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,527 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,529 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,531 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,532 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,534 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,536 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,537 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,539 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,541 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,542 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,544 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,546 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,548 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,549 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,551 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,553 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,555 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,556 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,558 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,560 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,562 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,564 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,565 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,567 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,569 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,571 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,572 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,574 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,576 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,577 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,579 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,581 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,582 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,584 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,586 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,588 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,589 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,591 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,593 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,595 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,596 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,598 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,600 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,602 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,604 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,606 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,608 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,610 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,612 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,613 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,615 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,617 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,619 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,621 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,623 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,624 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,626 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:40:10,629 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,630 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,632 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,634 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,636 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,637 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,639 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,641 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,643 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,644 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,646 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,648 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,650 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,652 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,654 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,656 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,657 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,659 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,661 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,663 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,665 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,666 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,668 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,670 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,671 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,673 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,675 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,677 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,679 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,680 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,682 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,684 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,686 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,687 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,689 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,691 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,693 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,695 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,696 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,698 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,700 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,702 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,704 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,706 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,707 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,709 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,711 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,713 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,714 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,716 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,718 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,720 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,722 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,723 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,725 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,727 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,729 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,731 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,733 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:40:10,734 copying build/lib/lm_eval/tasks/afrobench/sib/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-09-01T00:40:10,738 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,739 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,741 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,743 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,745 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,747 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,749 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,751 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,752 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,754 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,756 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,758 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,759 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,761 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,763 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,765 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,766 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,768 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,770 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,772 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,774 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,776 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,777 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,779 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,781 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,783 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,785 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,787 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,789 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,791 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,793 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,794 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,796 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,798 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,799 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,801 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,803 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,804 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,806 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,808 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,810 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,812 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,813 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,815 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,817 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,819 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,821 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,822 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,824 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,826 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,828 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,830 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,832 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,834 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,836 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,837 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,839 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,841 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,843 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:40:10,846 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,847 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,849 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,850 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,852 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,854 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,856 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,858 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,859 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,861 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,863 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,865 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,867 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,869 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,871 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,873 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,874 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,876 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,878 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,880 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,882 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,884 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,885 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,887 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,889 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,890 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,892 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,894 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,896 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,897 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,899 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,901 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,903 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,904 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,906 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,908 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,910 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,912 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,914 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,916 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,918 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,919 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,921 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,923 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,925 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,927 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,929 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,930 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,932 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,933 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,935 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,937 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,939 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,941 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,942 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,944 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,946 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,948 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,950 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:40:10,953 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,954 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,956 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,957 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,959 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,961 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,963 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,965 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,967 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,968 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,970 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,972 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,974 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,975 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,977 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,979 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,980 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,982 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,983 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,985 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,987 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,988 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,990 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,992 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,994 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,995 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,997 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:10,999 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,001 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,003 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,004 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,006 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,008 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,010 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,011 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,013 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,015 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,017 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,018 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,020 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,022 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,023 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,025 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,027 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,028 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,030 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,032 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,034 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,035 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,037 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,039 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,041 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,043 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,044 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,046 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,048 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,050 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,051 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,053 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:40:11,055 copying build/lib/lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-09-01T00:40:11,058 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr 2026-09-01T00:40:11,061 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,062 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,064 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,065 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,067 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,069 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,070 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,072 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,074 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,075 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,077 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,079 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,081 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,083 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,085 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,087 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,088 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,090 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,092 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,094 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,096 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,097 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,099 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,101 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,103 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,105 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,106 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,108 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,110 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,111 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,113 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,115 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,116 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,118 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,120 copying build/lib/lm_eval/tasks/mmlusr/answer_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,122 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,124 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,125 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,127 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,129 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,131 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,132 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,134 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,136 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,138 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,140 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,142 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,143 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,145 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,147 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,148 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,150 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,152 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,153 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,155 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,157 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,159 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,160 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,162 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,164 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,166 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:40:11,169 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,170 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,172 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,174 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,176 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,178 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,180 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,182 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,184 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,185 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,187 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,189 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,190 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,193 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,195 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,196 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,198 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,200 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,202 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,203 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,205 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,207 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,209 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,211 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,213 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,215 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,217 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,219 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,220 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,222 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,224 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,226 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,227 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,229 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,231 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,232 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,234 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,236 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,238 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,240 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,242 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,243 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,245 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,247 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,249 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,251 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,253 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,255 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,257 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,259 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,261 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,262 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,264 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,266 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,268 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,269 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,271 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,273 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,275 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,277 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,279 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:40:11,282 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,283 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,285 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,287 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,289 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,291 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,293 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,295 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,297 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,299 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,300 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,302 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,304 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,306 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,308 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,310 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,311 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,313 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,315 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,317 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,319 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,321 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,323 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,324 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,326 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,328 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,330 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,332 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,334 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,336 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,338 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,339 copying build/lib/lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,341 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,343 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,345 copying build/lib/lm_eval/tasks/mmlusr/question_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,346 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,348 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,350 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,351 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,353 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,355 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,357 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,358 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,360 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,362 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,363 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,365 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,367 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,369 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,370 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,372 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,374 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,376 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,378 copying build/lib/lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,379 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,381 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,383 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,384 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,386 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,388 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,391 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:40:11,393 copying build/lib/lm_eval/tasks/mmlusr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2026-09-01T00:40:11,395 copying build/lib/lm_eval/tasks/mmlusr/config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2026-09-01T00:40:11,398 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval 2026-09-01T00:40:11,399 copying build/lib/lm_eval/tasks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:40:11,402 copying build/lib/lm_eval/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:40:11,405 copying build/lib/lm_eval/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:40:11,408 copying build/lib/lm_eval/tasks/ifeval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:40:11,410 copying build/lib/lm_eval/tasks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:40:11,413 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:40:11,415 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:40:11,416 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:40:11,419 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:40:11,421 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:40:11,424 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-09-01T00:40:11,426 copying build/lib/lm_eval/tasks/ifeval/multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-09-01T00:40:11,429 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:40:11,430 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:40:11,433 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:40:11,437 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:40:11,438 copying build/lib/lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-09-01T00:40:11,440 copying build/lib/lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-09-01T00:40:11,442 copying build/lib/lm_eval/tasks/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:40:11,444 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench 2026-09-01T00:40:11,446 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:40:11,447 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:40:11,449 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:40:11,451 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:40:11,453 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:40:11,455 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:40:11,461 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:40:11,462 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:40:11,464 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:40:11,466 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:40:11,468 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:40:11,470 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:40:11,472 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:40:11,473 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:40:11,475 copying build/lib/lm_eval/tasks/darija_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench 2026-09-01T00:40:11,478 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,479 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,481 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,483 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,485 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,487 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,497 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,499 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,500 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,502 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:40:11,505 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,506 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,508 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,510 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,512 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,514 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,516 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,518 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,520 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,522 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,523 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,525 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,527 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,529 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,531 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,532 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,534 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,536 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,538 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,539 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,541 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,543 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,545 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,547 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,549 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,550 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,552 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,554 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,556 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,558 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,560 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,562 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,564 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:40:11,566 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval_infilling 2026-09-01T00:40:11,568 copying build/lib/lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:40:11,569 copying build/lib/lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:40:11,571 copying build/lib/lm_eval/tasks/humaneval_infilling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:40:11,573 copying build/lib/lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:40:11,575 copying build/lib/lm_eval/tasks/humaneval_infilling/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:40:11,577 copying build/lib/lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:40:11,578 copying build/lib/lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:40:11,581 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unitxt 2026-09-01T00:40:11,582 copying build/lib/lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,584 copying build/lib/lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,586 copying build/lib/lm_eval/tasks/unitxt/xsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,588 copying build/lib/lm_eval/tasks/unitxt/atis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,589 copying build/lib/lm_eval/tasks/unitxt/argument_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,591 copying build/lib/lm_eval/tasks/unitxt/stsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,593 copying build/lib/lm_eval/tasks/unitxt/unfair_tos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,594 copying build/lib/lm_eval/tasks/unitxt/ledgar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,596 copying build/lib/lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,598 copying build/lib/lm_eval/tasks/unitxt/ag_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,600 copying build/lib/lm_eval/tasks/unitxt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,602 copying build/lib/lm_eval/tasks/unitxt/doc_vqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,604 copying build/lib/lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,606 copying build/lib/lm_eval/tasks/unitxt/unitxt_multimodal -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,607 copying build/lib/lm_eval/tasks/unitxt/financial_tweets.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,609 copying build/lib/lm_eval/tasks/unitxt/coedit_gec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,611 copying build/lib/lm_eval/tasks/unitxt/banking77.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,613 copying build/lib/lm_eval/tasks/unitxt/unitxt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,615 copying build/lib/lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,617 copying build/lib/lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,618 copying build/lib/lm_eval/tasks/unitxt/ethos_binary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,620 copying build/lib/lm_eval/tasks/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,623 copying build/lib/lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:40:11,625 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu 2026-09-01T00:40:11,627 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,628 copying build/lib/lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,630 copying build/lib/lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,631 copying build/lib/lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,633 copying build/lib/lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,635 copying build/lib/lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,637 copying build/lib/lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,639 copying build/lib/lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,640 copying build/lib/lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,642 copying build/lib/lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,644 copying build/lib/lm_eval/tasks/turkishmmlu/config/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:40:11,647 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,648 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,650 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,652 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,654 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,657 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,659 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,661 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,664 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,666 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,668 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:40:11,671 copying build/lib/lm_eval/tasks/turkishmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu 2026-09-01T00:40:11,674 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3 2026-09-01T00:40:11,675 copying build/lib/lm_eval/tasks/llama3/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3 2026-09-01T00:40:11,678 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct 2026-09-01T00:40:11,679 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:40:11,681 copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:40:11,683 copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:40:11,687 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,688 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,690 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,692 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,694 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,696 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,699 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,700 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,703 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,705 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,707 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,709 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,710 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,712 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,714 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,717 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,719 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,721 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,723 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,725 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,728 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,730 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,732 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,735 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,737 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,739 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,741 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,743 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,746 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,748 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,750 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,752 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,755 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,757 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,759 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,761 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,763 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,765 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,766 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,768 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,771 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,773 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,775 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,777 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,779 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,781 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,783 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,785 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,786 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,788 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,790 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,792 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,794 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,796 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,798 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,800 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,802 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,804 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,806 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,809 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,812 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,815 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,819 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,822 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,826 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:40:11,839 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,840 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,845 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,849 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,851 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,854 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,857 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,859 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,862 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,864 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,867 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,869 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,872 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,874 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,877 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,880 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,883 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,886 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,888 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,891 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,893 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,896 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,898 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,901 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,904 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,907 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,910 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,912 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,916 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,919 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,922 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,925 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,928 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,931 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,934 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,937 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,941 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,943 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,946 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,949 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,952 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,954 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,957 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,959 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,962 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,966 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,969 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,972 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,975 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,977 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,980 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,982 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,985 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,987 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,990 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,993 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,995 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:11,998 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:12,001 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:12,003 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:12,006 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:12,008 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:12,010 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:12,013 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:12,016 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:40:12,020 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,021 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,024 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,026 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,028 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,031 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,033 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,035 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,038 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,040 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,042 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,044 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,046 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,048 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,050 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,053 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,055 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,057 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,059 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,062 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,064 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,066 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,068 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,070 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,072 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,074 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,076 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,078 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,080 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,081 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,083 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,085 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,088 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,090 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,092 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,094 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,097 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,099 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,101 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,103 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,105 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,107 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,109 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,111 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,113 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,115 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,117 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,119 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,121 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,123 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,126 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,128 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,130 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,132 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,134 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,136 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,138 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,140 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,142 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,145 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,147 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,149 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,151 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,153 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,155 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:40:12,159 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,160 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,163 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,165 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,167 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,172 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,174 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,176 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,181 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,187 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,191 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,193 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,196 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,199 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,202 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,204 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,207 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,210 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,214 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,217 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,221 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,224 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,228 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,231 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,234 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,237 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,241 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,244 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,249 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,253 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,258 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,262 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,266 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,270 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,274 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,278 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,282 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,286 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,289 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,292 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,296 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,300 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,309 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,312 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,315 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,319 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,321 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,325 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,327 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,330 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,333 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,336 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,339 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,342 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,345 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,348 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,351 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,353 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,355 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,358 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,360 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,362 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,365 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,367 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,370 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:40:12,373 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,374 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,376 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,378 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,380 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,382 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,384 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,386 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,388 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,390 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,391 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,394 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,396 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,398 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,400 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,402 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,404 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,406 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,408 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,410 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,412 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,415 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,417 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,420 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,422 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,424 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,427 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,430 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,432 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,435 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,437 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,440 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,443 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,445 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,448 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,451 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,454 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,457 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,460 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,463 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,465 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,468 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,471 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,473 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,476 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,478 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,481 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,483 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,485 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,488 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,490 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,493 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,496 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,498 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,501 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,503 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,505 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,508 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,510 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,513 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,516 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,518 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,521 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,523 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,526 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:40:12,529 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/gsm8k 2026-09-01T00:40:12,530 copying build/lib/lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/gsm8k 2026-09-01T00:40:12,534 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,535 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,538 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,540 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,543 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,545 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,547 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,549 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,551 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,554 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,556 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,559 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,561 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,563 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,566 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,568 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,571 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,573 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,575 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,579 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,581 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,583 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,586 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,588 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,591 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,593 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,595 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,597 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,599 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,601 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,604 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,606 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,609 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,611 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,613 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,616 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,618 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,620 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,623 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,625 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,627 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,630 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,632 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,634 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,636 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,639 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,641 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,643 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,645 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,647 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,649 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,652 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,654 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,656 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,659 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,661 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,663 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,665 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,667 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,670 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,672 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,674 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,676 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,679 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,689 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:40:12,693 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,695 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,697 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,700 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,702 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,704 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,706 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,709 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,711 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,713 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,715 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,717 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,719 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,721 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,723 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,726 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,728 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,730 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,732 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,734 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,737 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,739 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,741 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,743 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,745 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,748 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,750 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,752 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,754 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,756 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,758 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,760 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,762 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,764 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,767 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,769 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,771 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,773 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,776 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,778 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,780 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,782 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,784 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,787 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,789 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,791 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,794 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,796 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,798 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,800 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,802 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,805 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,807 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,809 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,812 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,814 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,816 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,818 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,820 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,823 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,825 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,827 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,829 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,832 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:40:12,836 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,837 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,839 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,841 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,844 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,846 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,848 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,851 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,853 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,855 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,857 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,859 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,861 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,863 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,866 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,868 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,870 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,872 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,874 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,877 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,879 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,881 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,883 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,885 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,887 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,890 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,891 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,894 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,896 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,898 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,900 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,902 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,904 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,907 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,909 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,911 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,913 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,915 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,917 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,919 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,922 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,924 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,926 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,928 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,930 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,933 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,935 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,937 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,939 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,942 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,944 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,946 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,949 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,951 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,953 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,955 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,958 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,960 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,962 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,964 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,966 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,969 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,971 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,973 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:40:12,976 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,978 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,980 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,982 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,984 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,987 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,989 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,991 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,993 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,995 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:12,998 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:13,000 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:13,003 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:13,006 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:13,009 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:13,012 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:13,015 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:13,018 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:40:13,022 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,023 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,026 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,028 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,031 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,034 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,037 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,039 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,042 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,045 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,047 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,050 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,052 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,055 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,057 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,059 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,061 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,063 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,065 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,067 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,069 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,071 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,073 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,076 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,078 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,081 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,083 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,088 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,091 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,093 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,096 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,098 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,100 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,102 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,104 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,106 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,108 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,110 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,112 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,114 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,116 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,118 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,120 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,122 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,124 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,126 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,128 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,130 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,132 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,134 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,136 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,138 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,140 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,142 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,144 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,146 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,148 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,150 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,152 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,154 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,157 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,159 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,160 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,162 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,164 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:40:13,167 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mutual 2026-09-01T00:40:13,168 copying build/lib/lm_eval/tasks/mutual/multual_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-09-01T00:40:13,170 copying build/lib/lm_eval/tasks/mutual/mutual.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-09-01T00:40:13,172 copying build/lib/lm_eval/tasks/mutual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-09-01T00:40:13,173 copying build/lib/lm_eval/tasks/mutual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-09-01T00:40:13,176 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice 2026-09-01T00:40:13,178 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq 2026-09-01T00:40:13,180 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:40:13,181 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:40:13,184 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:40:13,185 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:40:13,188 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:40:13,189 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:40:13,191 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:40:13,193 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:40:13,195 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:40:13,196 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:40:13,198 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:40:13,200 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:40:13,203 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:40:13,204 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:40:13,206 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:40:13,208 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:40:13,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:40:13,211 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:40:13,213 copying build/lib/lm_eval/tasks/aradice/openbookqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:40:13,215 copying build/lib/lm_eval/tasks/aradice/openbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:40:13,217 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:40:13,219 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:40:13,220 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:40:13,222 copying build/lib/lm_eval/tasks/aradice/aradice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice 2026-09-01T00:40:13,224 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:40:13,225 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:40:13,228 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:40:13,230 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:40:13,232 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:40:13,233 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:40:13,235 copying build/lib/lm_eval/tasks/aradice/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice 2026-09-01T00:40:13,238 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/piqa 2026-09-01T00:40:13,239 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:40:13,241 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:40:13,243 copying build/lib/lm_eval/tasks/aradice/piqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:40:13,244 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:40:13,246 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:40:13,249 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,250 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,252 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,254 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,255 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,257 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,259 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,261 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,263 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:40:13,265 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU 2026-09-01T00:40:13,267 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,268 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,270 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,272 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,274 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,276 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,278 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,279 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,281 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,283 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,285 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,287 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,288 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,290 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,292 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,294 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,296 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,297 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,299 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,301 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,303 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,304 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,306 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,308 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,310 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,312 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,313 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,315 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,317 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,319 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,321 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,323 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,324 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,326 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,328 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,330 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,332 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,334 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,336 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,337 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,339 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,341 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,342 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,344 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,346 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:40:13,349 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,350 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,352 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,354 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,356 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,358 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,359 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,361 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,363 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,365 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,367 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,369 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,371 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,373 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,375 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,377 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,378 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,380 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,382 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,383 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,385 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,387 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,389 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,391 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,393 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,395 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,396 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,398 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,400 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,402 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,404 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,406 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,408 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,410 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,412 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,413 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,415 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,417 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,419 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,421 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,423 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,425 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,427 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,429 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,434 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:40:13,437 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/winogrande 2026-09-01T00:40:13,438 copying build/lib/lm_eval/tasks/aradice/winogrande/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:40:13,440 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:40:13,442 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:40:13,444 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:40:13,446 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:40:13,448 copying build/lib/lm_eval/tasks/aradice/winogrande/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:40:13,451 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_proficiency 2026-09-01T00:40:13,452 copying build/lib/lm_eval/tasks/eus_proficiency/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2026-09-01T00:40:13,454 copying build/lib/lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2026-09-01T00:40:13,457 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbq 2026-09-01T00:40:13,458 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:40:13,460 copying build/lib/lm_eval/tasks/bbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:40:13,462 copying build/lib/lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:40:13,464 copying build/lib/lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:40:13,466 copying build/lib/lm_eval/tasks/bbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:40:13,469 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:40:13,471 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:40:13,473 copying build/lib/lm_eval/tasks/bbq/bbq_generate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:40:13,475 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tydiqa 2026-09-01T00:40:13,477 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,479 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,481 copying build/lib/lm_eval/tasks/tydiqa/_tydiqa_goldp_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,482 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_fi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,484 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,486 copying build/lib/lm_eval/tasks/tydiqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,488 copying build/lib/lm_eval/tasks/tydiqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,491 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,492 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,494 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,497 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,498 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:40:13,501 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu 2026-09-01T00:40:13,503 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot 2026-09-01T00:40:13,505 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,507 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,509 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,511 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,513 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,515 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,517 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,519 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,521 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,523 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,525 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,527 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,529 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,531 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,533 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,535 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,537 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,539 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,541 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,543 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,545 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,546 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,548 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,550 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,552 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,554 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,556 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,558 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,560 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,562 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,563 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,566 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,568 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,570 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,571 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,573 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,575 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,577 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,579 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,581 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,583 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,585 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,587 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,589 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,591 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,593 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,594 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,596 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,599 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,600 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,602 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,604 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,606 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,608 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,610 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,612 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,614 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,616 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,618 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,620 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:40:13,624 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,625 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,627 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,629 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,631 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,633 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,635 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,637 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,639 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,640 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,642 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,644 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,646 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,648 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,650 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,652 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,654 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,656 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,659 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,661 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,662 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,664 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,666 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,668 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,670 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,672 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,674 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,676 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,678 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,680 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,682 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,684 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,686 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,688 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,690 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,692 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,694 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,696 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,698 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,700 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,702 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,704 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,707 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,708 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,710 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,712 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,714 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,716 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,718 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,720 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,722 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,724 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,726 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,728 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,730 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,732 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,734 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,736 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,738 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,739 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,741 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:40:13,745 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,746 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,748 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,750 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,752 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,754 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,756 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,758 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,760 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,762 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,764 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,766 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,768 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,770 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,772 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,773 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,775 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,777 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,779 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,781 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,782 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,784 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,786 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,788 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,790 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,792 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,794 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,796 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,798 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,800 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,802 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,804 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,806 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,808 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,810 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,812 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,814 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,816 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,818 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,820 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,822 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,824 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,826 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,828 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,830 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,832 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,833 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,835 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,837 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,839 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,841 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,843 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,845 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,847 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,849 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,851 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,853 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,855 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,858 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,860 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,861 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:40:13,865 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,866 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,868 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,870 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,872 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,875 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,877 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,879 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,881 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,883 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,885 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,888 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,890 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,892 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,895 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,897 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,899 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,902 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,904 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,906 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,908 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,910 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,913 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,915 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,917 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,919 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,921 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,923 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,925 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,931 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,934 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,936 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,938 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,940 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,943 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,945 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,947 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,949 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,951 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,953 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,956 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,958 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,960 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,962 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,965 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,967 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,969 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,972 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,974 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,976 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,978 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,981 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,983 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,985 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,987 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,989 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,991 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,993 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,996 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:13,998 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:14,001 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:40:14,003 copying build/lib/lm_eval/tasks/mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2026-09-01T00:40:14,007 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,008 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,010 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,012 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,014 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,016 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,018 copying build/lib/lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,020 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,022 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,024 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,026 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,028 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,030 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,031 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,033 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,035 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,037 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,039 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,042 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,044 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,046 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,048 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,050 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,052 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,053 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,055 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,057 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,059 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,061 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,063 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,066 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,067 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,069 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,071 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,073 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,075 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,077 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,079 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,081 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,083 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,085 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,087 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,089 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,091 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,093 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,095 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,097 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,099 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,101 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,103 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,105 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,107 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,109 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,111 copying build/lib/lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,113 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,115 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,117 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,119 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,121 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,122 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:40:14,124 copying build/lib/lm_eval/tasks/mmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2026-09-01T00:40:14,129 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,130 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,132 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,134 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,136 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,138 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,140 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,142 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,144 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,147 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,149 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,151 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,153 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,155 copying build/lib/lm_eval/tasks/mmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,157 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,159 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,161 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,163 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,165 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,167 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,169 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,171 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,173 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,175 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,177 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,179 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,181 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,183 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,184 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,186 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,188 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,190 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,192 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,194 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,197 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,199 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,201 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,203 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,205 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,207 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,209 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,211 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,213 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,215 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,217 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,219 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,221 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,223 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,224 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,226 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,228 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,230 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,232 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,234 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,236 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,238 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,240 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,242 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,244 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,246 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,248 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,250 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,252 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,254 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:40:14,258 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,259 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,261 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,263 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,265 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,267 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,269 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,270 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,272 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,274 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,276 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,278 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,280 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,282 copying build/lib/lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,284 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,287 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,289 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,291 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,293 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,295 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,297 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,299 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,301 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,303 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,305 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,307 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,309 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,311 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,313 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,315 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,317 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,319 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,321 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,323 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,325 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,327 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,328 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,330 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,332 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,334 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,336 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,338 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,340 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,342 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,344 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,346 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,348 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,350 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,352 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,354 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,356 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,358 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,360 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,362 copying build/lib/lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,364 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,366 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,368 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,370 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,371 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,373 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:40:14,376 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wikitext 2026-09-01T00:40:14,377 copying build/lib/lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-09-01T00:40:14,379 copying build/lib/lm_eval/tasks/wikitext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-09-01T00:40:14,381 copying build/lib/lm_eval/tasks/wikitext/wikitext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-09-01T00:40:14,384 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile_10k 2026-09-01T00:40:14,385 copying build/lib/lm_eval/tasks/pile_10k/pile_10k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2026-09-01T00:40:14,387 copying build/lib/lm_eval/tasks/pile_10k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2026-09-01T00:40:14,389 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medqa 2026-09-01T00:40:14,391 copying build/lib/lm_eval/tasks/medqa/medqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2026-09-01T00:40:14,393 copying build/lib/lm_eval/tasks/medqa/preprocess_medqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2026-09-01T00:40:14,395 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medtext 2026-09-01T00:40:14,396 copying build/lib/lm_eval/tasks/medtext/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:40:14,398 copying build/lib/lm_eval/tasks/medtext/medtext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:40:14,400 copying build/lib/lm_eval/tasks/medtext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:40:14,402 copying build/lib/lm_eval/tasks/medtext/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:40:14,404 copying build/lib/lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:40:14,408 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noticia 2026-09-01T00:40:14,409 copying build/lib/lm_eval/tasks/noticia/noticia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-09-01T00:40:14,411 copying build/lib/lm_eval/tasks/noticia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-09-01T00:40:14,413 copying build/lib/lm_eval/tasks/noticia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-09-01T00:40:14,416 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/olaph 2026-09-01T00:40:14,417 copying build/lib/lm_eval/tasks/olaph/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:40:14,419 copying build/lib/lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:40:14,421 copying build/lib/lm_eval/tasks/olaph/olaph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:40:14,423 copying build/lib/lm_eval/tasks/olaph/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:40:14,425 copying build/lib/lm_eval/tasks/olaph/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:40:14,428 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/race 2026-09-01T00:40:14,429 copying build/lib/lm_eval/tasks/race/race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-09-01T00:40:14,431 copying build/lib/lm_eval/tasks/race/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-09-01T00:40:14,433 copying build/lib/lm_eval/tasks/race/preprocess_race.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-09-01T00:40:14,436 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/metabench 2026-09-01T00:40:14,437 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,439 copying build/lib/lm_eval/tasks/metabench/metabench_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,441 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,443 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,445 copying build/lib/lm_eval/tasks/metabench/metabench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,447 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,449 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,451 copying build/lib/lm_eval/tasks/metabench/metabench_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,452 copying build/lib/lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,454 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,456 copying build/lib/lm_eval/tasks/metabench/process_docs_permute.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,459 copying build/lib/lm_eval/tasks/metabench/metabench_arc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,461 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,463 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,465 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,467 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,469 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,471 copying build/lib/lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,473 copying build/lib/lm_eval/tasks/metabench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,476 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,478 copying build/lib/lm_eval/tasks/metabench/process_docs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,480 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,482 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,484 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,486 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,488 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,489 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,491 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,493 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:40:14,496 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xwinograd 2026-09-01T00:40:14,497 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,499 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,501 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,503 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,505 copying build/lib/lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,507 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,509 copying build/lib/lm_eval/tasks/xwinograd/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,511 copying build/lib/lm_eval/tasks/xwinograd/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,513 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,515 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:40:14,517 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual 2026-09-01T00:40:14,519 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:40:14,521 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:40:14,523 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:40:14,525 copying build/lib/lm_eval/tasks/lambada_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:40:14,527 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:40:14,529 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:40:14,531 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/anli 2026-09-01T00:40:14,533 copying build/lib/lm_eval/tasks/anli/anli_r1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-09-01T00:40:14,535 copying build/lib/lm_eval/tasks/anli/anli_r2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-09-01T00:40:14,536 copying build/lib/lm_eval/tasks/anli/anli_r3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-09-01T00:40:14,538 copying build/lib/lm_eval/tasks/anli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-09-01T00:40:14,541 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,542 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,544 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,546 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,548 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,550 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,552 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,553 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,555 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,557 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,559 copying build/lib/lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,561 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,563 copying build/lib/lm_eval/tasks/arab_culture_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,565 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,567 copying build/lib/lm_eval/tasks/arab_culture_completion/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,570 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,572 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,574 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,576 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,578 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,580 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,582 copying build/lib/lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,584 copying build/lib/lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,586 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:40:14,589 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paloma 2026-09-01T00:40:14,590 copying build/lib/lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,592 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,594 copying build/lib/lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,596 copying build/lib/lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,598 copying build/lib/lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,599 copying build/lib/lm_eval/tasks/paloma/paloma_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,601 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,603 copying build/lib/lm_eval/tasks/paloma/paloma_mc4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,605 copying build/lib/lm_eval/tasks/paloma/_paloma_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,607 copying build/lib/lm_eval/tasks/paloma/paloma_ptb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,609 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,611 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,613 copying build/lib/lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,615 copying build/lib/lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,617 copying build/lib/lm_eval/tasks/paloma/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,619 copying build/lib/lm_eval/tasks/paloma/paloma_gab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,621 copying build/lib/lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,622 copying build/lib/lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,624 copying build/lib/lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:40:14,627 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/graphwalks 2026-09-01T00:40:14,628 copying build/lib/lm_eval/tasks/graphwalks/graphwalks_128k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:40:14,630 copying build/lib/lm_eval/tasks/graphwalks/graphwalks_1M.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:40:14,632 copying build/lib/lm_eval/tasks/graphwalks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:40:14,634 copying build/lib/lm_eval/tasks/graphwalks/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:40:14,636 copying build/lib/lm_eval/tasks/graphwalks/graphwalks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:40:14,638 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/prost 2026-09-01T00:40:14,639 copying build/lib/lm_eval/tasks/prost/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2026-09-01T00:40:14,641 copying build/lib/lm_eval/tasks/prost/corypaik_prost.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2026-09-01T00:40:14,643 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/moral_stories 2026-09-01T00:40:14,644 copying build/lib/lm_eval/tasks/moral_stories/moral_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-09-01T00:40:14,646 copying build/lib/lm_eval/tasks/moral_stories/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-09-01T00:40:14,648 copying build/lib/lm_eval/tasks/moral_stories/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-09-01T00:40:14,651 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/sciq 2026-09-01T00:40:14,652 copying build/lib/lm_eval/tasks/sciq/sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2026-09-01T00:40:14,654 copying build/lib/lm_eval/tasks/sciq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2026-09-01T00:40:14,657 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swag 2026-09-01T00:40:14,658 copying build/lib/lm_eval/tasks/swag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2026-09-01T00:40:14,660 copying build/lib/lm_eval/tasks/swag/swag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2026-09-01T00:40:14,662 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/putnam_axiom 2026-09-01T00:40:14,663 copying build/lib/lm_eval/tasks/putnam_axiom/putnam_axiom_variations_org.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:40:14,665 copying build/lib/lm_eval/tasks/putnam_axiom/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:40:14,667 copying build/lib/lm_eval/tasks/putnam_axiom/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:40:14,670 copying build/lib/lm_eval/tasks/putnam_axiom/putnam_axiom_original.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:40:14,672 copying build/lib/lm_eval/tasks/putnam_axiom/putnam_axiom_variations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:40:14,674 copying build/lib/lm_eval/tasks/putnam_axiom/putnam_axiom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:40:14,677 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc 2026-09-01T00:40:14,678 copying build/lib/lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-09-01T00:40:14,680 copying build/lib/lm_eval/tasks/arc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-09-01T00:40:14,682 copying build/lib/lm_eval/tasks/arc/arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-09-01T00:40:14,684 copying build/lib/lm_eval/tasks/arc/arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-09-01T00:40:14,686 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/common_voice 2026-09-01T00:40:14,687 copying build/lib/lm_eval/tasks/common_voice/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice 2026-09-01T00:40:14,690 copying build/lib/lm_eval/tasks/common_voice/common_voice_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice 2026-09-01T00:40:14,692 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue 2026-09-01T00:40:14,694 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qqp 2026-09-01T00:40:14,695 copying build/lib/lm_eval/tasks/glue/qqp/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qqp 2026-09-01T00:40:14,698 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mnli 2026-09-01T00:40:14,699 copying build/lib/lm_eval/tasks/glue/mnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-09-01T00:40:14,701 copying build/lib/lm_eval/tasks/glue/mnli/mismatch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-09-01T00:40:14,702 copying build/lib/lm_eval/tasks/glue/mnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-09-01T00:40:14,705 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/wnli 2026-09-01T00:40:14,706 copying build/lib/lm_eval/tasks/glue/wnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/wnli 2026-09-01T00:40:14,709 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/rte 2026-09-01T00:40:14,710 copying build/lib/lm_eval/tasks/glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/rte 2026-09-01T00:40:14,712 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qnli 2026-09-01T00:40:14,713 copying build/lib/lm_eval/tasks/glue/qnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qnli 2026-09-01T00:40:14,715 copying build/lib/lm_eval/tasks/glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue 2026-09-01T00:40:14,718 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/sst2 2026-09-01T00:40:14,719 copying build/lib/lm_eval/tasks/glue/sst2/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/sst2 2026-09-01T00:40:14,721 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mrpc 2026-09-01T00:40:14,722 copying build/lib/lm_eval/tasks/glue/mrpc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mrpc 2026-09-01T00:40:14,725 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/cola 2026-09-01T00:40:14,726 copying build/lib/lm_eval/tasks/glue/cola/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/cola 2026-09-01T00:40:14,729 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qasper 2026-09-01T00:40:14,730 copying build/lib/lm_eval/tasks/qasper/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:40:14,732 copying build/lib/lm_eval/tasks/qasper/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:40:14,734 copying build/lib/lm_eval/tasks/qasper/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:40:14,736 copying build/lib/lm_eval/tasks/qasper/freeform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:40:14,738 copying build/lib/lm_eval/tasks/qasper/bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:40:14,740 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hellaswag 2026-09-01T00:40:14,741 copying build/lib/lm_eval/tasks/hellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-09-01T00:40:14,744 copying build/lib/lm_eval/tasks/hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-09-01T00:40:14,746 copying build/lib/lm_eval/tasks/hellaswag/hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-09-01T00:40:14,748 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/esbbq 2026-09-01T00:40:14,749 copying build/lib/lm_eval/tasks/esbbq/_esbbq_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,751 copying build/lib/lm_eval/tasks/esbbq/esbbq_ses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,753 copying build/lib/lm_eval/tasks/esbbq/esbbq_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,755 copying build/lib/lm_eval/tasks/esbbq/esbbq_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,757 copying build/lib/lm_eval/tasks/esbbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,759 copying build/lib/lm_eval/tasks/esbbq/esbbq_disability_status.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,761 copying build/lib/lm_eval/tasks/esbbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,763 copying build/lib/lm_eval/tasks/esbbq/esbbq_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,765 copying build/lib/lm_eval/tasks/esbbq/esbbq_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,767 copying build/lib/lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,769 copying build/lib/lm_eval/tasks/esbbq/esbbq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,771 copying build/lib/lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,772 copying build/lib/lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,774 copying build/lib/lm_eval/tasks/esbbq/esbbq_spanish_region.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:40:14,777 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/jfinqa 2026-09-01T00:40:14,778 copying build/lib/lm_eval/tasks/jfinqa/jfinqa_temporal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:40:14,780 copying build/lib/lm_eval/tasks/jfinqa/jfinqa_numerical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:40:14,782 copying build/lib/lm_eval/tasks/jfinqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:40:14,784 copying build/lib/lm_eval/tasks/jfinqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:40:14,786 copying build/lib/lm_eval/tasks/jfinqa/test_jfinqa_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:40:14,789 copying build/lib/lm_eval/tasks/jfinqa/jfinqa_consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:40:14,791 copying build/lib/lm_eval/tasks/jfinqa/_jfinqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:40:14,793 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench 2026-09-01T00:40:14,798 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,799 copying build/lib/lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,801 copying build/lib/lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,803 copying build/lib/lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,805 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,807 copying build/lib/lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,809 copying build/lib/lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,811 copying build/lib/lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,813 copying build/lib/lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,815 copying build/lib/lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,817 copying build/lib/lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,818 copying build/lib/lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,820 copying build/lib/lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,822 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,824 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,827 copying build/lib/lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,828 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,830 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,832 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,834 copying build/lib/lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,836 copying build/lib/lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,838 copying build/lib/lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,840 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,842 copying build/lib/lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,844 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,846 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,848 copying build/lib/lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,850 copying build/lib/lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,851 copying build/lib/lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,853 copying build/lib/lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,855 copying build/lib/lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,857 copying build/lib/lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,859 copying build/lib/lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,861 copying build/lib/lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,863 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,866 copying build/lib/lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,867 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,869 copying build/lib/lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,871 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,873 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,875 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,877 copying build/lib/lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,879 copying build/lib/lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,881 copying build/lib/lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,883 copying build/lib/lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,884 copying build/lib/lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,886 copying build/lib/lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,888 copying build/lib/lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,890 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,892 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,894 copying build/lib/lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,896 copying build/lib/lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,898 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,900 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,902 copying build/lib/lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,904 copying build/lib/lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,906 copying build/lib/lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,908 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,910 copying build/lib/lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,912 copying build/lib/lm_eval/tasks/bigbench/generate_until/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,914 copying build/lib/lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,916 copying build/lib/lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,918 copying build/lib/lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,920 copying build/lib/lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,922 copying build/lib/lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,924 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,925 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,927 copying build/lib/lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,929 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,931 copying build/lib/lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,933 copying build/lib/lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,935 copying build/lib/lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,937 copying build/lib/lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,939 copying build/lib/lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,941 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,943 copying build/lib/lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,944 copying build/lib/lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,947 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,948 copying build/lib/lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,950 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,952 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,954 copying build/lib/lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,956 copying build/lib/lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,958 copying build/lib/lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,960 copying build/lib/lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,961 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,963 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,965 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,967 copying build/lib/lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,969 copying build/lib/lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,971 copying build/lib/lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,973 copying build/lib/lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,975 copying build/lib/lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,977 copying build/lib/lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,979 copying build/lib/lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,981 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,982 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,985 copying build/lib/lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,986 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,988 copying build/lib/lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,990 copying build/lib/lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,992 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,994 copying build/lib/lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,996 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:14,998 copying build/lib/lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,000 copying build/lib/lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,002 copying build/lib/lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,004 copying build/lib/lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,006 copying build/lib/lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,008 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,010 copying build/lib/lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,011 copying build/lib/lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,013 copying build/lib/lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,015 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,017 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,019 copying build/lib/lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,021 copying build/lib/lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,023 copying build/lib/lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,025 copying build/lib/lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,027 copying build/lib/lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,029 copying build/lib/lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,031 copying build/lib/lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,032 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,034 copying build/lib/lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,037 copying build/lib/lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,038 copying build/lib/lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,040 copying build/lib/lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,042 copying build/lib/lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,044 copying build/lib/lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,046 copying build/lib/lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,048 copying build/lib/lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,050 copying build/lib/lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,051 copying build/lib/lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,053 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,055 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,057 copying build/lib/lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,059 copying build/lib/lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,061 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,063 copying build/lib/lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,065 copying build/lib/lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,067 copying build/lib/lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,069 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,071 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,073 copying build/lib/lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,075 copying build/lib/lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,077 copying build/lib/lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,078 copying build/lib/lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,080 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,082 copying build/lib/lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,084 copying build/lib/lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,086 copying build/lib/lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,088 copying build/lib/lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,089 copying build/lib/lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,091 copying build/lib/lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,093 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,095 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,097 copying build/lib/lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,099 copying build/lib/lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,101 copying build/lib/lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,103 copying build/lib/lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,104 copying build/lib/lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,106 copying build/lib/lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,108 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,110 copying build/lib/lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,112 copying build/lib/lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,114 copying build/lib/lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,116 copying build/lib/lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,118 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:40:15,120 copying build/lib/lm_eval/tasks/bigbench/generate_until_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:40:15,122 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:40:15,123 copying build/lib/lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:40:15,125 copying build/lib/lm_eval/tasks/bigbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:40:15,128 copying build/lib/lm_eval/tasks/bigbench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:40:15,129 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:40:15,134 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,135 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,137 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,139 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,141 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,143 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,145 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,147 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,149 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,150 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,152 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,154 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,156 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,158 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,160 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,162 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,163 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,165 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,167 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,169 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,170 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,172 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,174 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,176 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,177 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,179 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,181 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,182 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,184 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,186 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,188 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,190 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,192 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,193 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,195 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,197 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,199 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,201 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,203 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,205 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,207 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,209 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,211 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,213 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,214 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,216 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,218 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,220 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,222 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,224 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,226 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,228 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,229 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,231 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,233 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,235 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,237 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,239 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,241 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,243 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,245 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,246 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,248 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,250 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,252 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,254 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,256 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,258 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,260 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,262 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,264 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,266 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,267 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,269 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,271 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,273 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,275 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,277 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,279 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,281 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,283 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,285 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,287 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,289 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,291 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,293 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,295 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,297 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,299 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,301 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,302 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,304 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,306 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,308 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,310 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,312 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,314 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,316 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,318 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,320 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,321 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,323 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,325 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,327 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,329 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,331 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,333 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,335 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,337 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,339 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,341 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,343 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,345 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,347 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,349 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,351 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,353 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,355 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,356 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,358 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:40:15,360 copying build/lib/lm_eval/tasks/bigbench/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:40:15,363 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc 2026-09-01T00:40:15,365 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,367 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,369 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,371 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,373 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,375 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,377 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,379 copying build/lib/lm_eval/tasks/e2lmc/noor/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,381 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,383 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,384 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,387 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,388 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,390 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,392 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,394 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,396 copying build/lib/lm_eval/tasks/e2lmc/noor/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,398 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:40:15,401 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:40:15,402 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:40:15,404 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:40:15,406 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:40:15,408 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:40:15,409 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:40:15,412 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:40:15,413 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:40:15,415 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:40:15,417 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:40:15,419 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:40:15,421 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:40:15,424 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli_eu 2026-09-01T00:40:15,425 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:40:15,427 copying build/lib/lm_eval/tasks/xnli_eu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:40:15,429 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:40:15,431 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:40:15,433 copying build/lib/lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:40:15,436 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard 2026-09-01T00:40:15,437 copying build/lib/lm_eval/tasks/leaderboard/leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2026-09-01T00:40:15,439 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:40:15,440 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:40:15,442 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:40:15,444 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:40:15,446 copying build/lib/lm_eval/tasks/leaderboard/gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:40:15,448 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:40:15,450 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:40:15,453 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,454 copying build/lib/lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,456 copying build/lib/lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,458 copying build/lib/lm_eval/tasks/leaderboard/math/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,460 copying build/lib/lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,462 copying build/lib/lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,464 copying build/lib/lm_eval/tasks/leaderboard/math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,466 copying build/lib/lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,468 copying build/lib/lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,470 copying build/lib/lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,472 copying build/lib/lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:40:15,474 copying build/lib/lm_eval/tasks/leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2026-09-01T00:40:15,477 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:40:15,478 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:40:15,480 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:40:15,483 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:40:15,486 copying build/lib/lm_eval/tasks/leaderboard/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:40:15,488 copying build/lib/lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:40:15,490 copying build/lib/lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:40:15,492 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/musr 2026-09-01T00:40:15,494 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:40:15,495 copying build/lib/lm_eval/tasks/leaderboard/musr/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:40:15,497 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:40:15,499 copying build/lib/lm_eval/tasks/leaderboard/musr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:40:15,501 copying build/lib/lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:40:15,503 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:40:15,505 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:40:15,506 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:40:15,508 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:40:15,511 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,512 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,514 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,516 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,518 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,520 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,522 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,524 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,526 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,528 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,531 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,533 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,535 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,537 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,539 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,541 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,543 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,545 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,547 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,549 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,551 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,553 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,554 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,556 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,558 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,560 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,562 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:40:15,566 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp 2026-09-01T00:40:15,567 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,569 copying build/lib/lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,571 copying build/lib/lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,573 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,575 copying build/lib/lm_eval/tasks/blimp/intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,577 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,579 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,580 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,582 copying build/lib/lm_eval/tasks/blimp/generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,584 copying build/lib/lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,586 copying build/lib/lm_eval/tasks/blimp/transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,588 copying build/lib/lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,590 copying build/lib/lm_eval/tasks/blimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,592 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,594 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,595 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,597 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,599 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,601 copying build/lib/lm_eval/tasks/blimp/adjunct_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,602 copying build/lib/lm_eval/tasks/blimp/inchoative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,604 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,606 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,608 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,610 copying build/lib/lm_eval/tasks/blimp/_blimp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,612 copying build/lib/lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,613 copying build/lib/lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,615 copying build/lib/lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,617 copying build/lib/lm_eval/tasks/blimp/wh_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,619 copying build/lib/lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,621 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,622 copying build/lib/lm_eval/tasks/blimp/causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,624 copying build/lib/lm_eval/tasks/blimp/npi_present_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,626 copying build/lib/lm_eval/tasks/blimp/npi_present_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,628 copying build/lib/lm_eval/tasks/blimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,630 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,632 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,634 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,636 copying build/lib/lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,638 copying build/lib/lm_eval/tasks/blimp/drop_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,640 copying build/lib/lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,642 copying build/lib/lm_eval/tasks/blimp/passive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,643 copying build/lib/lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,645 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,647 copying build/lib/lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,648 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,650 copying build/lib/lm_eval/tasks/blimp/only_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,652 copying build/lib/lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,654 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,656 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,658 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,659 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,661 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,663 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,665 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,667 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,668 copying build/lib/lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,670 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,672 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,674 copying build/lib/lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,676 copying build/lib/lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,677 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,679 copying build/lib/lm_eval/tasks/blimp/passive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,681 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,683 copying build/lib/lm_eval/tasks/blimp/complex_NP_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,685 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,687 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,689 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,690 copying build/lib/lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,692 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,694 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,696 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:40:15,698 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/nerel-bench 2026-09-01T00:40:15,700 copying build/lib/lm_eval/tasks/nerel-bench/ru_relation_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:40:15,702 copying build/lib/lm_eval/tasks/nerel-bench/ru_entity_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:40:15,703 copying build/lib/lm_eval/tasks/nerel-bench/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:40:15,705 copying build/lib/lm_eval/tasks/nerel-bench/ru_relation_definition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:40:15,707 copying build/lib/lm_eval/tasks/nerel-bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:40:15,710 copying build/lib/lm_eval/tasks/nerel-bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:40:15,713 copying build/lib/lm_eval/tasks/nerel-bench/ru_entity_definition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:40:15,716 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/minerva_math 2026-09-01T00:40:15,717 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,719 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,721 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,723 copying build/lib/lm_eval/tasks/minerva_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,725 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,727 copying build/lib/lm_eval/tasks/minerva_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,730 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,732 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,734 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,736 copying build/lib/lm_eval/tasks/minerva_math/minerva_math500.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:40:15,738 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unscramble 2026-09-01T00:40:15,739 copying build/lib/lm_eval/tasks/unscramble/cycle_letters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:40:15,741 copying build/lib/lm_eval/tasks/unscramble/anagrams2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:40:15,743 copying build/lib/lm_eval/tasks/unscramble/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:40:15,745 copying build/lib/lm_eval/tasks/unscramble/reversed_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:40:15,748 copying build/lib/lm_eval/tasks/unscramble/anagrams1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:40:15,750 copying build/lib/lm_eval/tasks/unscramble/random_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:40:15,753 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squadv2 2026-09-01T00:40:15,754 copying build/lib/lm_eval/tasks/squadv2/squadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-09-01T00:40:15,756 copying build/lib/lm_eval/tasks/squadv2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-09-01T00:40:15,758 copying build/lib/lm_eval/tasks/squadv2/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-09-01T00:40:15,761 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,762 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,764 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,766 copying build/lib/lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,768 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,770 copying build/lib/lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,772 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,774 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,776 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,778 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,780 copying build/lib/lm_eval/tasks/mmlu_pro/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,782 copying build/lib/lm_eval/tasks/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,785 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,786 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,788 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,790 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,792 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,794 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,796 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:40:15,801 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/multiblimp 2026-09-01T00:40:15,802 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,804 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,806 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,808 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,810 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,812 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,813 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,815 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,817 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,819 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,820 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,822 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,824 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,826 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,828 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,830 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,831 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,833 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,835 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,837 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,839 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,841 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,843 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,844 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,846 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,848 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,850 copying build/lib/lm_eval/tasks/multiblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,852 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,854 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,855 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,857 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,859 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,861 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,862 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,864 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,866 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,868 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,870 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,872 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,874 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,876 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,877 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,879 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,881 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,883 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,885 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,886 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,888 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,890 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,892 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,894 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,896 copying build/lib/lm_eval/tasks/multiblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,899 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,900 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,902 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,904 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,906 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,908 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,910 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,912 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,914 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,916 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,917 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,919 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,921 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,922 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,924 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,926 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,928 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,929 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,931 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,933 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,935 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,937 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,939 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,941 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,943 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,945 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,947 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,949 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,950 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,952 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,954 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,957 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,959 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,961 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,963 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,965 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,967 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,969 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,971 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,973 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,975 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,977 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,979 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,981 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,983 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,984 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,987 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,989 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,991 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,993 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,995 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:40:15,997 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medmcqa 2026-09-01T00:40:15,998 copying build/lib/lm_eval/tasks/medmcqa/medmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2026-09-01T00:40:16,000 copying build/lib/lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2026-09-01T00:40:16,003 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/polemo2 2026-09-01T00:40:16,004 copying build/lib/lm_eval/tasks/polemo2/polemo2_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-09-01T00:40:16,006 copying build/lib/lm_eval/tasks/polemo2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-09-01T00:40:16,008 copying build/lib/lm_eval/tasks/polemo2/polemo2_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-09-01T00:40:16,011 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl 2026-09-01T00:40:16,013 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/reasoning 2026-09-01T00:40:16,014 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:40:16,016 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:40:16,019 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:40:16,021 copying build/lib/lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:40:16,023 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:40:16,024 copying build/lib/lm_eval/tasks/kbl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl 2026-09-01T00:40:16,028 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam 2026-09-01T00:40:16,029 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,031 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,033 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,034 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,036 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,038 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,040 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,042 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,044 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,046 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,047 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,049 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,051 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,053 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,056 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:40:16,058 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,060 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,062 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,064 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,066 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,067 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,069 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,071 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,073 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,075 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,076 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,078 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,080 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,082 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,084 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,086 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:40:16,088 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,089 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,091 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,093 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,095 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,097 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,099 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,101 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,103 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,105 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,107 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,109 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,111 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,112 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,114 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,116 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:40:16,118 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,119 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,121 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,123 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,125 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,127 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,129 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,131 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,132 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,134 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,136 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,138 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,140 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,142 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,144 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:40:16,146 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,147 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,150 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,152 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,154 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,156 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,157 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,159 copying build/lib/lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,161 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:40:16,164 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/libra 2026-09-01T00:40:16,165 copying build/lib/lm_eval/tasks/libra/ru_gsm100.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,167 copying build/lib/lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,169 copying build/lib/lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,171 copying build/lib/lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,173 copying build/lib/lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,174 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,176 copying build/lib/lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,178 copying build/lib/lm_eval/tasks/libra/ru_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,180 copying build/lib/lm_eval/tasks/libra/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,182 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,184 copying build/lib/lm_eval/tasks/libra/ru_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,186 copying build/lib/lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,188 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,190 copying build/lib/lm_eval/tasks/libra/librusec_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,191 copying build/lib/lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,193 copying build/lib/lm_eval/tasks/libra/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,196 copying build/lib/lm_eval/tasks/libra/matreshka_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,198 copying build/lib/lm_eval/tasks/libra/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,200 copying build/lib/lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,202 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,204 copying build/lib/lm_eval/tasks/libra/long_context_multiq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,206 copying build/lib/lm_eval/tasks/libra/passkey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,208 copying build/lib/lm_eval/tasks/libra/librusec_mhqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,210 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,211 copying build/lib/lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:40:16,214 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogrande 2026-09-01T00:40:16,215 copying build/lib/lm_eval/tasks/winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-09-01T00:40:16,217 copying build/lib/lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-09-01T00:40:16,219 copying build/lib/lm_eval/tasks/winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-09-01T00:40:16,222 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mc_taco 2026-09-01T00:40:16,223 copying build/lib/lm_eval/tasks/mc_taco/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2026-09-01T00:40:16,225 copying build/lib/lm_eval/tasks/mc_taco/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2026-09-01T00:40:16,228 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arithmetic 2026-09-01T00:40:16,229 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,231 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,233 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,235 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,237 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,239 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,241 copying build/lib/lm_eval/tasks/arithmetic/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,243 copying build/lib/lm_eval/tasks/arithmetic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,245 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,247 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,249 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,251 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:40:16,254 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bangla 2026-09-01T00:40:16,255 copying build/lib/lm_eval/tasks/bangla/bangla_openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:40:16,257 copying build/lib/lm_eval/tasks/bangla/bangla_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:40:16,259 copying build/lib/lm_eval/tasks/bangla/bangla_commonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:40:16,261 copying build/lib/lm_eval/tasks/bangla/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:40:16,263 copying build/lib/lm_eval/tasks/bangla/bangla_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:40:16,265 copying build/lib/lm_eval/tasks/bangla/bangla_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:40:16,270 copying build/lib/lm_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:40:16,273 copying build/lib/lm_eval/result_schema.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:40:16,276 copying build/lib/lm_eval/__main__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:40:16,278 copying build/lib/lm_eval/defaults.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:40:16,280 creating build/bdist.linux-armv7l/wheel/lm_eval/_cli 2026-09-01T00:40:16,281 copying build/lib/lm_eval/_cli/ls.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:40:16,284 copying build/lib/lm_eval/_cli/harness.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:40:16,286 copying build/lib/lm_eval/_cli/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:40:16,287 copying build/lib/lm_eval/_cli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:40:16,290 copying build/lib/lm_eval/_cli/validate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:40:16,292 copying build/lib/lm_eval/_cli/subcommand.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:40:16,294 copying build/lib/lm_eval/_cli/run.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:40:16,298 creating build/bdist.linux-armv7l/wheel/lm_eval/decontamination 2026-09-01T00:40:16,299 copying build/lib/lm_eval/decontamination/janitor.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-09-01T00:40:16,302 copying build/lib/lm_eval/decontamination/archiver.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-09-01T00:40:16,304 copying build/lib/lm_eval/decontamination/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-09-01T00:40:16,306 copying build/lib/lm_eval/decontamination/decontaminate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-09-01T00:40:16,309 creating build/bdist.linux-armv7l/wheel/lm_eval/api 2026-09-01T00:40:16,310 copying build/lib/lm_eval/api/model.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,313 copying build/lib/lm_eval/api/instance.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,315 copying build/lib/lm_eval/api/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,318 copying build/lib/lm_eval/api/filter.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,320 copying build/lib/lm_eval/api/registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,322 copying build/lib/lm_eval/api/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,324 copying build/lib/lm_eval/api/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,326 copying build/lib/lm_eval/api/samplers.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,329 copying build/lib/lm_eval/api/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,333 copying build/lib/lm_eval/api/group.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:40:16,339 running install_egg_info 2026-09-01T00:40:16,345 Copying lm_eval.egg-info to build/bdist.linux-armv7l/wheel/./lm_eval-0.4.13-py3.11.egg-info 2026-09-01T00:40:16,373 running install_scripts 2026-09-01T00:40:16,388 creating build/bdist.linux-armv7l/wheel/lm_eval-0.4.13.dist-info/WHEEL 2026-09-01T00:40:16,392 creating '/tmp/pip-wheel-dqt2b72a/.tmp-yauycdt2/lm_eval-0.4.13-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2026-09-01T00:40:16,394 adding 'lm_eval/__init__.py' 2026-09-01T00:40:16,396 adding 'lm_eval/__main__.py' 2026-09-01T00:40:16,397 adding 'lm_eval/defaults.py' 2026-09-01T00:40:16,401 adding 'lm_eval/evaluator.py' 2026-09-01T00:40:16,404 adding 'lm_eval/evaluator_utils.py' 2026-09-01T00:40:16,406 adding 'lm_eval/result_schema.py' 2026-09-01T00:40:16,410 adding 'lm_eval/utils.py' 2026-09-01T00:40:16,412 adding 'lm_eval/_cli/__init__.py' 2026-09-01T00:40:16,413 adding 'lm_eval/_cli/harness.py' 2026-09-01T00:40:16,415 adding 'lm_eval/_cli/ls.py' 2026-09-01T00:40:16,418 adding 'lm_eval/_cli/run.py' 2026-09-01T00:40:16,419 adding 'lm_eval/_cli/subcommand.py' 2026-09-01T00:40:16,421 adding 'lm_eval/_cli/utils.py' 2026-09-01T00:40:16,422 adding 'lm_eval/_cli/validate.py' 2026-09-01T00:40:16,424 adding 'lm_eval/api/__init__.py' 2026-09-01T00:40:16,425 adding 'lm_eval/api/filter.py' 2026-09-01T00:40:16,428 adding 'lm_eval/api/group.py' 2026-09-01T00:40:16,429 adding 'lm_eval/api/instance.py' 2026-09-01T00:40:16,432 adding 'lm_eval/api/metrics.py' 2026-09-01T00:40:16,434 adding 'lm_eval/api/model.py' 2026-09-01T00:40:16,437 adding 'lm_eval/api/registry.py' 2026-09-01T00:40:16,439 adding 'lm_eval/api/samplers.py' 2026-09-01T00:40:16,447 adding 'lm_eval/api/task.py' 2026-09-01T00:40:16,449 adding 'lm_eval/api/utils.py' 2026-09-01T00:40:16,451 adding 'lm_eval/caching/__init__.py' 2026-09-01T00:40:16,452 adding 'lm_eval/caching/cache.py' 2026-09-01T00:40:16,454 adding 'lm_eval/config/__init__.py' 2026-09-01T00:40:16,456 adding 'lm_eval/config/evaluate_config.py' 2026-09-01T00:40:16,458 adding 'lm_eval/config/group.py' 2026-09-01T00:40:16,459 adding 'lm_eval/config/task.py' 2026-09-01T00:40:16,461 adding 'lm_eval/decontamination/__init__.py' 2026-09-01T00:40:16,463 adding 'lm_eval/decontamination/archiver.py' 2026-09-01T00:40:16,464 adding 'lm_eval/decontamination/decontaminate.py' 2026-09-01T00:40:16,466 adding 'lm_eval/decontamination/janitor.py' 2026-09-01T00:40:16,469 adding 'lm_eval/filters/__init__.py' 2026-09-01T00:40:16,470 adding 'lm_eval/filters/custom.py' 2026-09-01T00:40:16,471 adding 'lm_eval/filters/decontamination.py' 2026-09-01T00:40:16,473 adding 'lm_eval/filters/extraction.py' 2026-09-01T00:40:16,475 adding 'lm_eval/filters/selection.py' 2026-09-01T00:40:16,476 adding 'lm_eval/filters/transformation.py' 2026-09-01T00:40:16,478 adding 'lm_eval/loggers/__init__.py' 2026-09-01T00:40:16,481 adding 'lm_eval/loggers/evaluation_tracker.py' 2026-09-01T00:40:16,483 adding 'lm_eval/loggers/trackio_logger.py' 2026-09-01T00:40:16,484 adding 'lm_eval/loggers/utils.py' 2026-09-01T00:40:16,486 adding 'lm_eval/loggers/wandb_logger.py' 2026-09-01T00:40:16,489 adding 'lm_eval/models/__init__.py' 2026-09-01T00:40:16,491 adding 'lm_eval/models/_onnx_base.py' 2026-09-01T00:40:16,493 adding 'lm_eval/models/anthropic_llms.py' 2026-09-01T00:40:16,497 adding 'lm_eval/models/api_models.py' 2026-09-01T00:40:16,498 adding 'lm_eval/models/dummy.py' 2026-09-01T00:40:16,500 adding 'lm_eval/models/gguf.py' 2026-09-01T00:40:16,502 adding 'lm_eval/models/hf_audiolm.py' 2026-09-01T00:40:16,504 adding 'lm_eval/models/hf_steered.py' 2026-09-01T00:40:16,508 adding 'lm_eval/models/hf_vlms.py' 2026-09-01T00:40:16,517 adding 'lm_eval/models/huggingface.py' 2026-09-01T00:40:16,520 adding 'lm_eval/models/ibm_watsonx_ai.py' 2026-09-01T00:40:16,521 adding 'lm_eval/models/litellm_llms.py' 2026-09-01T00:40:16,523 adding 'lm_eval/models/mamba_lm.py' 2026-09-01T00:40:16,529 adding 'lm_eval/models/megatron_lm.py' 2026-09-01T00:40:16,531 adding 'lm_eval/models/mistral3.py' 2026-09-01T00:40:16,534 adding 'lm_eval/models/nemo_lm.py' 2026-09-01T00:40:16,538 adding 'lm_eval/models/neuron_optimum.py' 2026-09-01T00:40:16,540 adding 'lm_eval/models/onnxruntime_genai.py' 2026-09-01T00:40:16,543 adding 'lm_eval/models/onnxruntime_ort.py' 2026-09-01T00:40:16,546 adding 'lm_eval/models/openai_completions.py' 2026-09-01T00:40:16,549 adding 'lm_eval/models/optimum_habana.py' 2026-09-01T00:40:16,551 adding 'lm_eval/models/optimum_ipex.py' 2026-09-01T00:40:16,553 adding 'lm_eval/models/optimum_lm.py' 2026-09-01T00:40:16,558 adding 'lm_eval/models/sglang_causallms.py' 2026-09-01T00:40:16,560 adding 'lm_eval/models/sglang_generate_API.py' 2026-09-01T00:40:16,562 adding 'lm_eval/models/textsynth.py' 2026-09-01T00:40:16,567 adding 'lm_eval/models/trtllm_causallms.py' 2026-09-01T00:40:16,575 adding 'lm_eval/models/utils.py' 2026-09-01T00:40:16,578 adding 'lm_eval/models/utils_hf.py' 2026-09-01T00:40:16,584 adding 'lm_eval/models/vllm_causallms.py' 2026-09-01T00:40:16,588 adding 'lm_eval/models/vllm_vlms.py' 2026-09-01T00:40:16,590 adding 'lm_eval/models/winml.py' 2026-09-01T00:40:16,593 adding 'lm_eval/prompts/__init__.py' 2026-09-01T00:40:16,621 adding 'lm_eval/tasks/README.md' 2026-09-01T00:40:16,625 adding 'lm_eval/tasks/__init__.py' 2026-09-01T00:40:16,628 adding 'lm_eval/tasks/_factory.py' 2026-09-01T00:40:16,631 adding 'lm_eval/tasks/_index.py' 2026-09-01T00:40:16,633 adding 'lm_eval/tasks/_yaml_loader.py' 2026-09-01T00:40:16,637 adding 'lm_eval/tasks/manager.py' 2026-09-01T00:40:16,640 adding 'lm_eval/tasks/aclue/README.md' 2026-09-01T00:40:16,641 adding 'lm_eval/tasks/aclue/_aclue.yaml' 2026-09-01T00:40:16,643 adding 'lm_eval/tasks/aclue/_default_template_yaml' 2026-09-01T00:40:16,644 adding 'lm_eval/tasks/aclue/_generate_configs.py' 2026-09-01T00:40:16,645 adding 'lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml' 2026-09-01T00:40:16,647 adding 'lm_eval/tasks/aclue/aclue_ancient_literature.yaml' 2026-09-01T00:40:16,648 adding 'lm_eval/tasks/aclue/aclue_ancient_medical.yaml' 2026-09-01T00:40:16,649 adding 'lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml' 2026-09-01T00:40:16,650 adding 'lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml' 2026-09-01T00:40:16,651 adding 'lm_eval/tasks/aclue/aclue_couplet_prediction.yaml' 2026-09-01T00:40:16,653 adding 'lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml' 2026-09-01T00:40:16,654 adding 'lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml' 2026-09-01T00:40:16,655 adding 'lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml' 2026-09-01T00:40:16,656 adding 'lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml' 2026-09-01T00:40:16,657 adding 'lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml' 2026-09-01T00:40:16,659 adding 'lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml' 2026-09-01T00:40:16,660 adding 'lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml' 2026-09-01T00:40:16,661 adding 'lm_eval/tasks/aclue/aclue_reading_comprehension.yaml' 2026-09-01T00:40:16,662 adding 'lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml' 2026-09-01T00:40:16,665 adding 'lm_eval/tasks/acpbench/README.md' 2026-09-01T00:40:16,666 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml' 2026-09-01T00:40:16,668 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml' 2026-09-01T00:40:16,669 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml' 2026-09-01T00:40:16,671 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml' 2026-09-01T00:40:16,673 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml' 2026-09-01T00:40:16,674 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml' 2026-09-01T00:40:16,676 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml' 2026-09-01T00:40:16,677 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml' 2026-09-01T00:40:16,679 adding 'lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot' 2026-09-01T00:40:16,680 adding 'lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark' 2026-09-01T00:40:16,685 adding 'lm_eval/tasks/acpbench/gen_2shot/acp_utils.py' 2026-09-01T00:40:16,686 adding 'lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml' 2026-09-01T00:40:16,688 adding 'lm_eval/tasks/acpbench/gen_2shot/app.yaml' 2026-09-01T00:40:16,690 adding 'lm_eval/tasks/acpbench/gen_2shot/just.yaml' 2026-09-01T00:40:16,691 adding 'lm_eval/tasks/acpbench/gen_2shot/land.yaml' 2026-09-01T00:40:16,693 adding 'lm_eval/tasks/acpbench/gen_2shot/next_act.yaml' 2026-09-01T00:40:16,695 adding 'lm_eval/tasks/acpbench/gen_2shot/prog.yaml' 2026-09-01T00:40:16,696 adding 'lm_eval/tasks/acpbench/gen_2shot/reach.yaml' 2026-09-01T00:40:16,698 adding 'lm_eval/tasks/acpbench/gen_2shot/val.yaml' 2026-09-01T00:40:16,700 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot' 2026-09-01T00:40:16,701 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark' 2026-09-01T00:40:16,705 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py' 2026-09-01T00:40:16,707 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml' 2026-09-01T00:40:16,709 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml' 2026-09-01T00:40:16,717 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml' 2026-09-01T00:40:16,719 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml' 2026-09-01T00:40:16,721 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml' 2026-09-01T00:40:16,723 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml' 2026-09-01T00:40:16,725 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml' 2026-09-01T00:40:16,727 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml' 2026-09-01T00:40:16,728 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml' 2026-09-01T00:40:16,730 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml' 2026-09-01T00:40:16,731 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml' 2026-09-01T00:40:16,732 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml' 2026-09-01T00:40:16,734 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml' 2026-09-01T00:40:16,735 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml' 2026-09-01T00:40:16,736 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml' 2026-09-01T00:40:16,738 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml' 2026-09-01T00:40:16,740 adding 'lm_eval/tasks/aexams/README.md' 2026-09-01T00:40:16,741 adding 'lm_eval/tasks/aexams/_aexams.yaml' 2026-09-01T00:40:16,742 adding 'lm_eval/tasks/aexams/_default_template_yaml' 2026-09-01T00:40:16,743 adding 'lm_eval/tasks/aexams/aexams_Biology.yaml' 2026-09-01T00:40:16,744 adding 'lm_eval/tasks/aexams/aexams_IslamicStudies.yaml' 2026-09-01T00:40:16,746 adding 'lm_eval/tasks/aexams/aexams_Physics.yaml' 2026-09-01T00:40:16,747 adding 'lm_eval/tasks/aexams/aexams_Science.yaml' 2026-09-01T00:40:16,748 adding 'lm_eval/tasks/aexams/aexams_Social.yaml' 2026-09-01T00:40:16,750 adding 'lm_eval/tasks/afrimgsm/README.md' 2026-09-01T00:40:16,751 adding 'lm_eval/tasks/afrimgsm/gen_utils.py' 2026-09-01T00:40:16,753 adding 'lm_eval/tasks/afrimgsm/gen_yaml.sh' 2026-09-01T00:40:16,754 adding 'lm_eval/tasks/afrimgsm/run.sh' 2026-09-01T00:40:16,755 adding 'lm_eval/tasks/afrimgsm/utils.py' 2026-09-01T00:40:16,757 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml' 2026-09-01T00:40:16,759 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml' 2026-09-01T00:40:16,760 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml' 2026-09-01T00:40:16,762 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml' 2026-09-01T00:40:16,763 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml' 2026-09-01T00:40:16,764 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml' 2026-09-01T00:40:16,765 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml' 2026-09-01T00:40:16,766 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml' 2026-09-01T00:40:16,768 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml' 2026-09-01T00:40:16,769 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml' 2026-09-01T00:40:16,770 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml' 2026-09-01T00:40:16,771 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml' 2026-09-01T00:40:16,772 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml' 2026-09-01T00:40:16,773 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml' 2026-09-01T00:40:16,775 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml' 2026-09-01T00:40:16,776 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml' 2026-09-01T00:40:16,777 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml' 2026-09-01T00:40:16,778 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml' 2026-09-01T00:40:16,779 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml' 2026-09-01T00:40:16,780 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml' 2026-09-01T00:40:16,781 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml' 2026-09-01T00:40:16,783 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml' 2026-09-01T00:40:16,784 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml' 2026-09-01T00:40:16,786 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml' 2026-09-01T00:40:16,787 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml' 2026-09-01T00:40:16,788 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml' 2026-09-01T00:40:16,789 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml' 2026-09-01T00:40:16,790 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml' 2026-09-01T00:40:16,791 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml' 2026-09-01T00:40:16,793 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml' 2026-09-01T00:40:16,794 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml' 2026-09-01T00:40:16,795 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml' 2026-09-01T00:40:16,796 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml' 2026-09-01T00:40:16,797 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml' 2026-09-01T00:40:16,798 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml' 2026-09-01T00:40:16,799 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml' 2026-09-01T00:40:16,801 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml' 2026-09-01T00:40:16,802 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml' 2026-09-01T00:40:16,803 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml' 2026-09-01T00:40:16,804 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml' 2026-09-01T00:40:16,805 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml' 2026-09-01T00:40:16,807 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml' 2026-09-01T00:40:16,808 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml' 2026-09-01T00:40:16,809 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml' 2026-09-01T00:40:16,810 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml' 2026-09-01T00:40:16,811 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml' 2026-09-01T00:40:16,813 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml' 2026-09-01T00:40:16,814 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml' 2026-09-01T00:40:16,815 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml' 2026-09-01T00:40:16,816 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml' 2026-09-01T00:40:16,818 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml' 2026-09-01T00:40:16,819 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml' 2026-09-01T00:40:16,820 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml' 2026-09-01T00:40:16,821 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml' 2026-09-01T00:40:16,822 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml' 2026-09-01T00:40:16,823 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml' 2026-09-01T00:40:16,825 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml' 2026-09-01T00:40:16,826 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml' 2026-09-01T00:40:16,827 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml' 2026-09-01T00:40:16,828 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml' 2026-09-01T00:40:16,829 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml' 2026-09-01T00:40:16,831 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml' 2026-09-01T00:40:16,833 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml' 2026-09-01T00:40:16,834 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml' 2026-09-01T00:40:16,835 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml' 2026-09-01T00:40:16,836 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml' 2026-09-01T00:40:16,837 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml' 2026-09-01T00:40:16,838 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml' 2026-09-01T00:40:16,840 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml' 2026-09-01T00:40:16,841 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml' 2026-09-01T00:40:16,842 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml' 2026-09-01T00:40:16,843 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml' 2026-09-01T00:40:16,844 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml' 2026-09-01T00:40:16,845 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml' 2026-09-01T00:40:16,846 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml' 2026-09-01T00:40:16,848 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml' 2026-09-01T00:40:16,849 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml' 2026-09-01T00:40:16,850 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml' 2026-09-01T00:40:16,851 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml' 2026-09-01T00:40:16,852 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml' 2026-09-01T00:40:16,854 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml' 2026-09-01T00:40:16,855 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml' 2026-09-01T00:40:16,857 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml' 2026-09-01T00:40:16,858 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml' 2026-09-01T00:40:16,859 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml' 2026-09-01T00:40:16,860 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml' 2026-09-01T00:40:16,861 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml' 2026-09-01T00:40:16,863 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml' 2026-09-01T00:40:16,864 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml' 2026-09-01T00:40:16,865 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml' 2026-09-01T00:40:16,866 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml' 2026-09-01T00:40:16,867 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml' 2026-09-01T00:40:16,869 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml' 2026-09-01T00:40:16,870 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml' 2026-09-01T00:40:16,871 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml' 2026-09-01T00:40:16,873 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml' 2026-09-01T00:40:16,874 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml' 2026-09-01T00:40:16,875 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml' 2026-09-01T00:40:16,876 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml' 2026-09-01T00:40:16,878 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml' 2026-09-01T00:40:16,879 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml' 2026-09-01T00:40:16,881 adding 'lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml' 2026-09-01T00:40:16,883 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml' 2026-09-01T00:40:16,884 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml' 2026-09-01T00:40:16,885 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml' 2026-09-01T00:40:16,886 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml' 2026-09-01T00:40:16,887 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml' 2026-09-01T00:40:16,888 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml' 2026-09-01T00:40:16,889 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml' 2026-09-01T00:40:16,890 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml' 2026-09-01T00:40:16,892 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml' 2026-09-01T00:40:16,893 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml' 2026-09-01T00:40:16,894 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml' 2026-09-01T00:40:16,895 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml' 2026-09-01T00:40:16,896 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml' 2026-09-01T00:40:16,897 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml' 2026-09-01T00:40:16,898 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml' 2026-09-01T00:40:16,900 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml' 2026-09-01T00:40:16,901 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml' 2026-09-01T00:40:16,902 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml' 2026-09-01T00:40:16,903 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml' 2026-09-01T00:40:16,904 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml' 2026-09-01T00:40:16,906 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml' 2026-09-01T00:40:16,907 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml' 2026-09-01T00:40:16,909 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml' 2026-09-01T00:40:16,910 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml' 2026-09-01T00:40:16,911 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml' 2026-09-01T00:40:16,912 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml' 2026-09-01T00:40:16,913 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml' 2026-09-01T00:40:16,914 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml' 2026-09-01T00:40:16,916 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml' 2026-09-01T00:40:16,917 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml' 2026-09-01T00:40:16,918 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml' 2026-09-01T00:40:16,919 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml' 2026-09-01T00:40:16,920 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml' 2026-09-01T00:40:16,921 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml' 2026-09-01T00:40:16,923 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml' 2026-09-01T00:40:16,924 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml' 2026-09-01T00:40:16,925 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml' 2026-09-01T00:40:16,926 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml' 2026-09-01T00:40:16,928 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml' 2026-09-01T00:40:16,929 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml' 2026-09-01T00:40:16,931 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml' 2026-09-01T00:40:16,932 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml' 2026-09-01T00:40:16,933 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml' 2026-09-01T00:40:16,934 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml' 2026-09-01T00:40:16,936 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml' 2026-09-01T00:40:16,937 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml' 2026-09-01T00:40:16,938 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml' 2026-09-01T00:40:16,939 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml' 2026-09-01T00:40:16,940 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml' 2026-09-01T00:40:16,941 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml' 2026-09-01T00:40:16,942 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml' 2026-09-01T00:40:16,943 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml' 2026-09-01T00:40:16,945 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml' 2026-09-01T00:40:16,946 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml' 2026-09-01T00:40:16,947 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml' 2026-09-01T00:40:16,948 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml' 2026-09-01T00:40:16,949 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml' 2026-09-01T00:40:16,950 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml' 2026-09-01T00:40:16,951 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml' 2026-09-01T00:40:16,953 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml' 2026-09-01T00:40:16,954 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml' 2026-09-01T00:40:16,956 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml' 2026-09-01T00:40:16,957 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml' 2026-09-01T00:40:16,958 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml' 2026-09-01T00:40:16,959 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml' 2026-09-01T00:40:16,960 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml' 2026-09-01T00:40:16,962 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml' 2026-09-01T00:40:16,963 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml' 2026-09-01T00:40:16,964 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml' 2026-09-01T00:40:16,965 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml' 2026-09-01T00:40:16,966 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml' 2026-09-01T00:40:16,968 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml' 2026-09-01T00:40:16,969 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml' 2026-09-01T00:40:16,970 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml' 2026-09-01T00:40:16,971 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml' 2026-09-01T00:40:16,972 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml' 2026-09-01T00:40:16,974 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml' 2026-09-01T00:40:16,975 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml' 2026-09-01T00:40:16,976 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml' 2026-09-01T00:40:16,978 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml' 2026-09-01T00:40:16,979 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml' 2026-09-01T00:40:16,981 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml' 2026-09-01T00:40:16,982 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml' 2026-09-01T00:40:16,983 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml' 2026-09-01T00:40:16,985 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml' 2026-09-01T00:40:16,986 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml' 2026-09-01T00:40:16,987 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml' 2026-09-01T00:40:16,988 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml' 2026-09-01T00:40:16,989 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml' 2026-09-01T00:40:16,990 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml' 2026-09-01T00:40:16,991 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml' 2026-09-01T00:40:16,993 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml' 2026-09-01T00:40:16,994 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml' 2026-09-01T00:40:16,995 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml' 2026-09-01T00:40:16,996 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml' 2026-09-01T00:40:16,998 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml' 2026-09-01T00:40:16,999 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml' 2026-09-01T00:40:17,000 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml' 2026-09-01T00:40:17,001 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml' 2026-09-01T00:40:17,002 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml' 2026-09-01T00:40:17,004 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml' 2026-09-01T00:40:17,006 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml' 2026-09-01T00:40:17,007 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml' 2026-09-01T00:40:17,008 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml' 2026-09-01T00:40:17,009 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml' 2026-09-01T00:40:17,011 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml' 2026-09-01T00:40:17,012 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml' 2026-09-01T00:40:17,013 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml' 2026-09-01T00:40:17,014 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml' 2026-09-01T00:40:17,015 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml' 2026-09-01T00:40:17,017 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml' 2026-09-01T00:40:17,018 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml' 2026-09-01T00:40:17,019 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml' 2026-09-01T00:40:17,020 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml' 2026-09-01T00:40:17,021 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml' 2026-09-01T00:40:17,022 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml' 2026-09-01T00:40:17,024 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml' 2026-09-01T00:40:17,025 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml' 2026-09-01T00:40:17,026 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml' 2026-09-01T00:40:17,028 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml' 2026-09-01T00:40:17,029 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml' 2026-09-01T00:40:17,030 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml' 2026-09-01T00:40:17,032 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml' 2026-09-01T00:40:17,033 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml' 2026-09-01T00:40:17,034 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml' 2026-09-01T00:40:17,035 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml' 2026-09-01T00:40:17,036 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml' 2026-09-01T00:40:17,037 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml' 2026-09-01T00:40:17,038 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml' 2026-09-01T00:40:17,039 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml' 2026-09-01T00:40:17,040 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml' 2026-09-01T00:40:17,041 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml' 2026-09-01T00:40:17,042 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml' 2026-09-01T00:40:17,043 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml' 2026-09-01T00:40:17,045 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml' 2026-09-01T00:40:17,046 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml' 2026-09-01T00:40:17,047 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml' 2026-09-01T00:40:17,049 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml' 2026-09-01T00:40:17,050 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml' 2026-09-01T00:40:17,051 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml' 2026-09-01T00:40:17,052 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml' 2026-09-01T00:40:17,054 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml' 2026-09-01T00:40:17,055 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml' 2026-09-01T00:40:17,056 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml' 2026-09-01T00:40:17,057 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml' 2026-09-01T00:40:17,058 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml' 2026-09-01T00:40:17,059 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml' 2026-09-01T00:40:17,060 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml' 2026-09-01T00:40:17,062 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml' 2026-09-01T00:40:17,063 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml' 2026-09-01T00:40:17,064 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml' 2026-09-01T00:40:17,065 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml' 2026-09-01T00:40:17,066 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml' 2026-09-01T00:40:17,068 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml' 2026-09-01T00:40:17,069 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml' 2026-09-01T00:40:17,071 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml' 2026-09-01T00:40:17,072 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml' 2026-09-01T00:40:17,073 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml' 2026-09-01T00:40:17,075 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml' 2026-09-01T00:40:17,076 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml' 2026-09-01T00:40:17,077 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml' 2026-09-01T00:40:17,078 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml' 2026-09-01T00:40:17,079 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml' 2026-09-01T00:40:17,081 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml' 2026-09-01T00:40:17,082 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml' 2026-09-01T00:40:17,083 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml' 2026-09-01T00:40:17,084 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml' 2026-09-01T00:40:17,085 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml' 2026-09-01T00:40:17,086 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml' 2026-09-01T00:40:17,087 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml' 2026-09-01T00:40:17,088 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml' 2026-09-01T00:40:17,090 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml' 2026-09-01T00:40:17,091 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml' 2026-09-01T00:40:17,093 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml' 2026-09-01T00:40:17,094 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml' 2026-09-01T00:40:17,095 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml' 2026-09-01T00:40:17,096 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml' 2026-09-01T00:40:17,097 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml' 2026-09-01T00:40:17,099 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml' 2026-09-01T00:40:17,100 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml' 2026-09-01T00:40:17,101 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml' 2026-09-01T00:40:17,102 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml' 2026-09-01T00:40:17,103 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml' 2026-09-01T00:40:17,104 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml' 2026-09-01T00:40:17,106 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml' 2026-09-01T00:40:17,107 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml' 2026-09-01T00:40:17,108 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml' 2026-09-01T00:40:17,109 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml' 2026-09-01T00:40:17,110 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml' 2026-09-01T00:40:17,112 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml' 2026-09-01T00:40:17,113 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml' 2026-09-01T00:40:17,115 adding 'lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml' 2026-09-01T00:40:17,117 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:40:17,118 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:40:17,119 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:40:17,120 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:40:17,121 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:40:17,123 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:40:17,124 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:40:17,125 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:40:17,126 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:40:17,128 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:40:17,129 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:40:17,130 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:40:17,131 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:40:17,132 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:40:17,133 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:40:17,134 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:40:17,136 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml' 2026-09-01T00:40:17,137 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:40:17,138 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:40:17,140 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:40:17,141 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:40:17,142 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:40:17,169 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:40:17,170 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:40:17,171 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:40:17,172 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:40:17,174 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:40:17,175 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:40:17,176 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:40:17,177 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:40:17,178 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:40:17,180 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:40:17,181 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:40:17,182 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:40:17,183 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:40:17,184 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml' 2026-09-01T00:40:17,185 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:40:17,187 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:40:17,189 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:40:17,190 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:40:17,191 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:40:17,192 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:40:17,193 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:40:17,194 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:40:17,196 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:40:17,197 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:40:17,198 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:40:17,199 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:40:17,200 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:40:17,201 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:40:17,202 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:40:17,204 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:40:17,205 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:40:17,206 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:40:17,207 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml' 2026-09-01T00:40:17,209 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:40:17,210 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:40:17,212 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:40:17,213 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:40:17,214 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:40:17,216 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:40:17,217 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:40:17,218 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:40:17,219 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:40:17,220 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:40:17,222 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:40:17,223 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:40:17,224 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:40:17,225 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:40:17,226 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:40:17,228 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:40:17,229 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:40:17,230 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:40:17,231 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml' 2026-09-01T00:40:17,232 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:40:17,234 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:40:17,236 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:40:17,237 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:40:17,238 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:40:17,239 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:40:17,241 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:40:17,242 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:40:17,243 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:40:17,244 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:40:17,246 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:40:17,247 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:40:17,248 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:40:17,249 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:40:17,251 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:40:17,252 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:40:17,253 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:40:17,255 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:40:17,256 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml' 2026-09-01T00:40:17,258 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:40:17,259 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:40:17,261 adding 'lm_eval/tasks/afrimmlu/README.md' 2026-09-01T00:40:17,262 adding 'lm_eval/tasks/afrimmlu/fewshot.sh' 2026-09-01T00:40:17,264 adding 'lm_eval/tasks/afrimmlu/gen_utils.py' 2026-09-01T00:40:17,265 adding 'lm_eval/tasks/afrimmlu/utils.py' 2026-09-01T00:40:17,266 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml' 2026-09-01T00:40:17,269 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct' 2026-09-01T00:40:17,270 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml' 2026-09-01T00:40:17,271 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml' 2026-09-01T00:40:17,272 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml' 2026-09-01T00:40:17,273 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml' 2026-09-01T00:40:17,274 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml' 2026-09-01T00:40:17,276 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml' 2026-09-01T00:40:17,277 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml' 2026-09-01T00:40:17,278 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml' 2026-09-01T00:40:17,281 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml' 2026-09-01T00:40:17,282 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml' 2026-09-01T00:40:17,282 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml' 2026-09-01T00:40:17,283 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml' 2026-09-01T00:40:17,283 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml' 2026-09-01T00:40:17,285 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml' 2026-09-01T00:40:17,286 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml' 2026-09-01T00:40:17,287 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml' 2026-09-01T00:40:17,288 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml' 2026-09-01T00:40:17,290 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml' 2026-09-01T00:40:17,291 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py' 2026-09-01T00:40:17,293 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct' 2026-09-01T00:40:17,294 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml' 2026-09-01T00:40:17,295 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml' 2026-09-01T00:40:17,297 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml' 2026-09-01T00:40:17,298 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml' 2026-09-01T00:40:17,300 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml' 2026-09-01T00:40:17,301 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml' 2026-09-01T00:40:17,302 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml' 2026-09-01T00:40:17,303 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml' 2026-09-01T00:40:17,304 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml' 2026-09-01T00:40:17,305 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml' 2026-09-01T00:40:17,307 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml' 2026-09-01T00:40:17,308 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml' 2026-09-01T00:40:17,309 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml' 2026-09-01T00:40:17,310 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml' 2026-09-01T00:40:17,311 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml' 2026-09-01T00:40:17,312 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml' 2026-09-01T00:40:17,314 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml' 2026-09-01T00:40:17,315 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml' 2026-09-01T00:40:17,316 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py' 2026-09-01T00:40:17,318 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct' 2026-09-01T00:40:17,319 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml' 2026-09-01T00:40:17,320 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml' 2026-09-01T00:40:17,321 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml' 2026-09-01T00:40:17,322 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml' 2026-09-01T00:40:17,324 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml' 2026-09-01T00:40:17,325 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml' 2026-09-01T00:40:17,326 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml' 2026-09-01T00:40:17,327 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml' 2026-09-01T00:40:17,328 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml' 2026-09-01T00:40:17,329 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml' 2026-09-01T00:40:17,331 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml' 2026-09-01T00:40:17,332 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml' 2026-09-01T00:40:17,333 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml' 2026-09-01T00:40:17,334 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml' 2026-09-01T00:40:17,335 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml' 2026-09-01T00:40:17,336 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml' 2026-09-01T00:40:17,338 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml' 2026-09-01T00:40:17,339 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml' 2026-09-01T00:40:17,340 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py' 2026-09-01T00:40:17,342 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct' 2026-09-01T00:40:17,343 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml' 2026-09-01T00:40:17,344 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml' 2026-09-01T00:40:17,346 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml' 2026-09-01T00:40:17,347 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml' 2026-09-01T00:40:17,348 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml' 2026-09-01T00:40:17,349 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml' 2026-09-01T00:40:17,350 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml' 2026-09-01T00:40:17,351 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml' 2026-09-01T00:40:17,352 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml' 2026-09-01T00:40:17,353 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml' 2026-09-01T00:40:17,354 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml' 2026-09-01T00:40:17,355 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml' 2026-09-01T00:40:17,357 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml' 2026-09-01T00:40:17,358 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml' 2026-09-01T00:40:17,359 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml' 2026-09-01T00:40:17,360 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml' 2026-09-01T00:40:17,361 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml' 2026-09-01T00:40:17,362 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml' 2026-09-01T00:40:17,364 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py' 2026-09-01T00:40:17,366 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct' 2026-09-01T00:40:17,367 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml' 2026-09-01T00:40:17,368 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml' 2026-09-01T00:40:17,369 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml' 2026-09-01T00:40:17,370 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml' 2026-09-01T00:40:17,371 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml' 2026-09-01T00:40:17,372 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml' 2026-09-01T00:40:17,373 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml' 2026-09-01T00:40:17,374 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml' 2026-09-01T00:40:17,376 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml' 2026-09-01T00:40:17,377 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml' 2026-09-01T00:40:17,378 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml' 2026-09-01T00:40:17,379 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml' 2026-09-01T00:40:17,380 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml' 2026-09-01T00:40:17,381 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml' 2026-09-01T00:40:17,382 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml' 2026-09-01T00:40:17,384 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml' 2026-09-01T00:40:17,385 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml' 2026-09-01T00:40:17,386 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml' 2026-09-01T00:40:17,387 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py' 2026-09-01T00:40:17,389 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml' 2026-09-01T00:40:17,391 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate' 2026-09-01T00:40:17,392 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml' 2026-09-01T00:40:17,393 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml' 2026-09-01T00:40:17,394 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml' 2026-09-01T00:40:17,395 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml' 2026-09-01T00:40:17,397 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml' 2026-09-01T00:40:17,398 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml' 2026-09-01T00:40:17,399 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml' 2026-09-01T00:40:17,400 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml' 2026-09-01T00:40:17,401 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml' 2026-09-01T00:40:17,402 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml' 2026-09-01T00:40:17,403 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml' 2026-09-01T00:40:17,404 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml' 2026-09-01T00:40:17,405 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml' 2026-09-01T00:40:17,406 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml' 2026-09-01T00:40:17,407 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml' 2026-09-01T00:40:17,409 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml' 2026-09-01T00:40:17,410 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml' 2026-09-01T00:40:17,411 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py' 2026-09-01T00:40:17,413 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate' 2026-09-01T00:40:17,414 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml' 2026-09-01T00:40:17,415 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml' 2026-09-01T00:40:17,416 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml' 2026-09-01T00:40:17,417 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml' 2026-09-01T00:40:17,418 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml' 2026-09-01T00:40:17,420 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml' 2026-09-01T00:40:17,421 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml' 2026-09-01T00:40:17,422 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml' 2026-09-01T00:40:17,423 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml' 2026-09-01T00:40:17,424 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml' 2026-09-01T00:40:17,425 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml' 2026-09-01T00:40:17,427 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml' 2026-09-01T00:40:17,428 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml' 2026-09-01T00:40:17,429 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml' 2026-09-01T00:40:17,430 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml' 2026-09-01T00:40:17,431 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml' 2026-09-01T00:40:17,433 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml' 2026-09-01T00:40:17,434 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py' 2026-09-01T00:40:17,436 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate' 2026-09-01T00:40:17,437 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml' 2026-09-01T00:40:17,438 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml' 2026-09-01T00:40:17,439 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml' 2026-09-01T00:40:17,441 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml' 2026-09-01T00:40:17,442 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml' 2026-09-01T00:40:17,443 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml' 2026-09-01T00:40:17,444 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml' 2026-09-01T00:40:17,445 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml' 2026-09-01T00:40:17,446 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml' 2026-09-01T00:40:17,448 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml' 2026-09-01T00:40:17,449 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml' 2026-09-01T00:40:17,450 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml' 2026-09-01T00:40:17,451 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml' 2026-09-01T00:40:17,452 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml' 2026-09-01T00:40:17,453 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml' 2026-09-01T00:40:17,454 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml' 2026-09-01T00:40:17,456 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml' 2026-09-01T00:40:17,457 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py' 2026-09-01T00:40:17,459 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate' 2026-09-01T00:40:17,460 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml' 2026-09-01T00:40:17,461 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml' 2026-09-01T00:40:17,462 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml' 2026-09-01T00:40:17,464 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml' 2026-09-01T00:40:17,465 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml' 2026-09-01T00:40:17,466 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml' 2026-09-01T00:40:17,467 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml' 2026-09-01T00:40:17,468 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml' 2026-09-01T00:40:17,469 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml' 2026-09-01T00:40:17,471 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml' 2026-09-01T00:40:17,472 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml' 2026-09-01T00:40:17,473 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml' 2026-09-01T00:40:17,474 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml' 2026-09-01T00:40:17,475 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml' 2026-09-01T00:40:17,477 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml' 2026-09-01T00:40:17,478 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml' 2026-09-01T00:40:17,479 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml' 2026-09-01T00:40:17,480 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py' 2026-09-01T00:40:17,482 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate' 2026-09-01T00:40:17,483 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml' 2026-09-01T00:40:17,485 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml' 2026-09-01T00:40:17,486 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml' 2026-09-01T00:40:17,487 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml' 2026-09-01T00:40:17,488 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml' 2026-09-01T00:40:17,490 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml' 2026-09-01T00:40:17,491 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml' 2026-09-01T00:40:17,492 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml' 2026-09-01T00:40:17,493 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml' 2026-09-01T00:40:17,494 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml' 2026-09-01T00:40:17,496 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml' 2026-09-01T00:40:17,497 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml' 2026-09-01T00:40:17,498 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml' 2026-09-01T00:40:17,499 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml' 2026-09-01T00:40:17,500 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml' 2026-09-01T00:40:17,501 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml' 2026-09-01T00:40:17,502 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml' 2026-09-01T00:40:17,504 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py' 2026-09-01T00:40:17,506 adding 'lm_eval/tasks/afrixnli/README.md' 2026-09-01T00:40:17,508 adding 'lm_eval/tasks/afrixnli/gen_utils.py' 2026-09-01T00:40:17,509 adding 'lm_eval/tasks/afrixnli/utils.py' 2026-09-01T00:40:17,512 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml' 2026-09-01T00:40:17,513 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml' 2026-09-01T00:40:17,514 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml' 2026-09-01T00:40:17,515 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml' 2026-09-01T00:40:17,516 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml' 2026-09-01T00:40:17,517 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml' 2026-09-01T00:40:17,519 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml' 2026-09-01T00:40:17,520 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml' 2026-09-01T00:40:17,521 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml' 2026-09-01T00:40:17,522 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml' 2026-09-01T00:40:17,523 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml' 2026-09-01T00:40:17,524 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml' 2026-09-01T00:40:17,526 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml' 2026-09-01T00:40:17,527 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml' 2026-09-01T00:40:17,528 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml' 2026-09-01T00:40:17,529 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml' 2026-09-01T00:40:17,530 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml' 2026-09-01T00:40:17,531 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml' 2026-09-01T00:40:17,533 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml' 2026-09-01T00:40:17,534 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py' 2026-09-01T00:40:17,536 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml' 2026-09-01T00:40:17,537 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml' 2026-09-01T00:40:17,538 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml' 2026-09-01T00:40:17,539 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml' 2026-09-01T00:40:17,541 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml' 2026-09-01T00:40:17,542 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml' 2026-09-01T00:40:17,543 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml' 2026-09-01T00:40:17,544 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml' 2026-09-01T00:40:17,545 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml' 2026-09-01T00:40:17,547 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml' 2026-09-01T00:40:17,548 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml' 2026-09-01T00:40:17,549 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml' 2026-09-01T00:40:17,550 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml' 2026-09-01T00:40:17,551 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml' 2026-09-01T00:40:17,552 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml' 2026-09-01T00:40:17,553 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml' 2026-09-01T00:40:17,555 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml' 2026-09-01T00:40:17,556 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml' 2026-09-01T00:40:17,557 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml' 2026-09-01T00:40:17,558 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py' 2026-09-01T00:40:17,560 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml' 2026-09-01T00:40:17,561 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml' 2026-09-01T00:40:17,563 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml' 2026-09-01T00:40:17,564 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml' 2026-09-01T00:40:17,565 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml' 2026-09-01T00:40:17,566 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml' 2026-09-01T00:40:17,567 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml' 2026-09-01T00:40:17,568 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml' 2026-09-01T00:40:17,570 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml' 2026-09-01T00:40:17,571 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml' 2026-09-01T00:40:17,572 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml' 2026-09-01T00:40:17,573 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml' 2026-09-01T00:40:17,574 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml' 2026-09-01T00:40:17,575 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml' 2026-09-01T00:40:17,577 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml' 2026-09-01T00:40:17,578 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml' 2026-09-01T00:40:17,579 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml' 2026-09-01T00:40:17,580 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml' 2026-09-01T00:40:17,582 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/utils.py' 2026-09-01T00:40:17,583 adding 'lm_eval/tasks/afrixnli/direct/afrixnli.yaml' 2026-09-01T00:40:17,585 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml' 2026-09-01T00:40:17,587 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml' 2026-09-01T00:40:17,588 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml' 2026-09-01T00:40:17,589 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml' 2026-09-01T00:40:17,590 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml' 2026-09-01T00:40:17,591 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml' 2026-09-01T00:40:17,593 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml' 2026-09-01T00:40:17,594 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml' 2026-09-01T00:40:17,595 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml' 2026-09-01T00:40:17,596 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml' 2026-09-01T00:40:17,597 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml' 2026-09-01T00:40:17,598 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml' 2026-09-01T00:40:17,600 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml' 2026-09-01T00:40:17,601 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml' 2026-09-01T00:40:17,602 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml' 2026-09-01T00:40:17,603 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml' 2026-09-01T00:40:17,604 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml' 2026-09-01T00:40:17,606 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml' 2026-09-01T00:40:17,607 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml' 2026-09-01T00:40:17,608 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/utils.py' 2026-09-01T00:40:17,610 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml' 2026-09-01T00:40:17,611 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml' 2026-09-01T00:40:17,612 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml' 2026-09-01T00:40:17,613 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml' 2026-09-01T00:40:17,615 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml' 2026-09-01T00:40:17,616 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml' 2026-09-01T00:40:17,617 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml' 2026-09-01T00:40:17,618 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml' 2026-09-01T00:40:17,619 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml' 2026-09-01T00:40:17,620 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml' 2026-09-01T00:40:17,622 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml' 2026-09-01T00:40:17,623 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml' 2026-09-01T00:40:17,624 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml' 2026-09-01T00:40:17,625 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml' 2026-09-01T00:40:17,626 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml' 2026-09-01T00:40:17,628 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml' 2026-09-01T00:40:17,629 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml' 2026-09-01T00:40:17,630 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml' 2026-09-01T00:40:17,631 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml' 2026-09-01T00:40:17,632 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/utils.py' 2026-09-01T00:40:17,634 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml' 2026-09-01T00:40:17,636 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml' 2026-09-01T00:40:17,637 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml' 2026-09-01T00:40:17,638 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml' 2026-09-01T00:40:17,639 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml' 2026-09-01T00:40:17,641 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml' 2026-09-01T00:40:17,642 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml' 2026-09-01T00:40:17,643 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml' 2026-09-01T00:40:17,644 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml' 2026-09-01T00:40:17,645 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml' 2026-09-01T00:40:17,647 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml' 2026-09-01T00:40:17,648 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml' 2026-09-01T00:40:17,649 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml' 2026-09-01T00:40:17,650 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml' 2026-09-01T00:40:17,651 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml' 2026-09-01T00:40:17,652 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml' 2026-09-01T00:40:17,654 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml' 2026-09-01T00:40:17,655 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml' 2026-09-01T00:40:17,656 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml' 2026-09-01T00:40:17,657 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/utils.py' 2026-09-01T00:40:17,659 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml' 2026-09-01T00:40:17,660 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml' 2026-09-01T00:40:17,662 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml' 2026-09-01T00:40:17,663 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml' 2026-09-01T00:40:17,664 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml' 2026-09-01T00:40:17,665 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml' 2026-09-01T00:40:17,667 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml' 2026-09-01T00:40:17,668 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml' 2026-09-01T00:40:17,669 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml' 2026-09-01T00:40:17,670 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml' 2026-09-01T00:40:17,671 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml' 2026-09-01T00:40:17,673 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml' 2026-09-01T00:40:17,674 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml' 2026-09-01T00:40:17,675 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml' 2026-09-01T00:40:17,676 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml' 2026-09-01T00:40:17,678 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml' 2026-09-01T00:40:17,679 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml' 2026-09-01T00:40:17,680 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml' 2026-09-01T00:40:17,681 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml' 2026-09-01T00:40:17,682 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/utils.py' 2026-09-01T00:40:17,684 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml' 2026-09-01T00:40:17,686 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml' 2026-09-01T00:40:17,687 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml' 2026-09-01T00:40:17,688 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml' 2026-09-01T00:40:17,689 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml' 2026-09-01T00:40:17,690 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml' 2026-09-01T00:40:17,692 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml' 2026-09-01T00:40:17,693 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml' 2026-09-01T00:40:17,694 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml' 2026-09-01T00:40:17,695 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml' 2026-09-01T00:40:17,697 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml' 2026-09-01T00:40:17,698 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml' 2026-09-01T00:40:17,699 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml' 2026-09-01T00:40:17,700 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml' 2026-09-01T00:40:17,702 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml' 2026-09-01T00:40:17,703 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml' 2026-09-01T00:40:17,704 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml' 2026-09-01T00:40:17,705 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml' 2026-09-01T00:40:17,706 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml' 2026-09-01T00:40:17,707 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/utils.py' 2026-09-01T00:40:17,710 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml' 2026-09-01T00:40:17,711 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml' 2026-09-01T00:40:17,712 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml' 2026-09-01T00:40:17,713 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml' 2026-09-01T00:40:17,714 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml' 2026-09-01T00:40:17,715 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml' 2026-09-01T00:40:17,717 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml' 2026-09-01T00:40:17,718 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml' 2026-09-01T00:40:17,719 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml' 2026-09-01T00:40:17,720 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml' 2026-09-01T00:40:17,721 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml' 2026-09-01T00:40:17,722 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml' 2026-09-01T00:40:17,723 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml' 2026-09-01T00:40:17,724 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml' 2026-09-01T00:40:17,726 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml' 2026-09-01T00:40:17,727 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml' 2026-09-01T00:40:17,728 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml' 2026-09-01T00:40:17,729 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml' 2026-09-01T00:40:17,730 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml' 2026-09-01T00:40:17,731 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/utils.py' 2026-09-01T00:40:17,734 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml' 2026-09-01T00:40:17,735 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml' 2026-09-01T00:40:17,736 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml' 2026-09-01T00:40:17,737 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml' 2026-09-01T00:40:17,738 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml' 2026-09-01T00:40:17,739 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml' 2026-09-01T00:40:17,741 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml' 2026-09-01T00:40:17,742 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml' 2026-09-01T00:40:17,743 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml' 2026-09-01T00:40:17,744 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml' 2026-09-01T00:40:17,745 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml' 2026-09-01T00:40:17,747 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml' 2026-09-01T00:40:17,748 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml' 2026-09-01T00:40:17,749 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml' 2026-09-01T00:40:17,750 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml' 2026-09-01T00:40:17,751 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml' 2026-09-01T00:40:17,752 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml' 2026-09-01T00:40:17,753 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml' 2026-09-01T00:40:17,754 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/utils.py' 2026-09-01T00:40:17,756 adding 'lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml' 2026-09-01T00:40:17,758 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml' 2026-09-01T00:40:17,759 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml' 2026-09-01T00:40:17,760 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml' 2026-09-01T00:40:17,762 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml' 2026-09-01T00:40:17,763 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml' 2026-09-01T00:40:17,764 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml' 2026-09-01T00:40:17,765 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml' 2026-09-01T00:40:17,766 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml' 2026-09-01T00:40:17,768 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml' 2026-09-01T00:40:17,769 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml' 2026-09-01T00:40:17,770 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml' 2026-09-01T00:40:17,771 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml' 2026-09-01T00:40:17,772 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml' 2026-09-01T00:40:17,774 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml' 2026-09-01T00:40:17,775 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml' 2026-09-01T00:40:17,776 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml' 2026-09-01T00:40:17,777 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml' 2026-09-01T00:40:17,779 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml' 2026-09-01T00:40:17,780 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/utils.py' 2026-09-01T00:40:17,782 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml' 2026-09-01T00:40:17,783 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml' 2026-09-01T00:40:17,784 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml' 2026-09-01T00:40:17,785 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml' 2026-09-01T00:40:17,786 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml' 2026-09-01T00:40:17,788 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml' 2026-09-01T00:40:17,789 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml' 2026-09-01T00:40:17,790 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml' 2026-09-01T00:40:17,791 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml' 2026-09-01T00:40:17,792 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml' 2026-09-01T00:40:17,793 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml' 2026-09-01T00:40:17,794 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml' 2026-09-01T00:40:17,796 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml' 2026-09-01T00:40:17,797 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml' 2026-09-01T00:40:17,798 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml' 2026-09-01T00:40:17,799 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml' 2026-09-01T00:40:17,800 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml' 2026-09-01T00:40:17,801 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml' 2026-09-01T00:40:17,802 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/utils.py' 2026-09-01T00:40:17,804 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml' 2026-09-01T00:40:17,805 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml' 2026-09-01T00:40:17,806 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml' 2026-09-01T00:40:17,808 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml' 2026-09-01T00:40:17,809 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml' 2026-09-01T00:40:17,810 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml' 2026-09-01T00:40:17,811 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml' 2026-09-01T00:40:17,812 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml' 2026-09-01T00:40:17,813 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml' 2026-09-01T00:40:17,815 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml' 2026-09-01T00:40:17,816 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml' 2026-09-01T00:40:17,817 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml' 2026-09-01T00:40:17,818 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml' 2026-09-01T00:40:17,819 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml' 2026-09-01T00:40:17,820 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml' 2026-09-01T00:40:17,821 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml' 2026-09-01T00:40:17,823 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml' 2026-09-01T00:40:17,824 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml' 2026-09-01T00:40:17,825 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/utils.py' 2026-09-01T00:40:17,827 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml' 2026-09-01T00:40:17,828 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml' 2026-09-01T00:40:17,829 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml' 2026-09-01T00:40:17,831 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml' 2026-09-01T00:40:17,832 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml' 2026-09-01T00:40:17,833 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml' 2026-09-01T00:40:17,834 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml' 2026-09-01T00:40:17,836 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml' 2026-09-01T00:40:17,837 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml' 2026-09-01T00:40:17,838 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml' 2026-09-01T00:40:17,839 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml' 2026-09-01T00:40:17,841 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml' 2026-09-01T00:40:17,842 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml' 2026-09-01T00:40:17,843 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml' 2026-09-01T00:40:17,844 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml' 2026-09-01T00:40:17,845 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml' 2026-09-01T00:40:17,847 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml' 2026-09-01T00:40:17,848 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml' 2026-09-01T00:40:17,849 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/utils.py' 2026-09-01T00:40:17,851 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml' 2026-09-01T00:40:17,852 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml' 2026-09-01T00:40:17,853 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml' 2026-09-01T00:40:17,854 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml' 2026-09-01T00:40:17,855 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml' 2026-09-01T00:40:17,856 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml' 2026-09-01T00:40:17,858 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml' 2026-09-01T00:40:17,859 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml' 2026-09-01T00:40:17,860 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml' 2026-09-01T00:40:17,861 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml' 2026-09-01T00:40:17,862 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml' 2026-09-01T00:40:17,863 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml' 2026-09-01T00:40:17,865 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml' 2026-09-01T00:40:17,866 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml' 2026-09-01T00:40:17,867 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml' 2026-09-01T00:40:17,868 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml' 2026-09-01T00:40:17,869 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml' 2026-09-01T00:40:17,870 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml' 2026-09-01T00:40:17,872 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/utils.py' 2026-09-01T00:40:17,874 adding 'lm_eval/tasks/afrobench/README.md' 2026-09-01T00:40:17,875 adding 'lm_eval/tasks/afrobench/afrobench-lite.yaml' 2026-09-01T00:40:17,876 adding 'lm_eval/tasks/afrobench/afrobench.yaml' 2026-09-01T00:40:17,878 adding 'lm_eval/tasks/afrobench/adr/README.md' 2026-09-01T00:40:17,879 adding 'lm_eval/tasks/afrobench/adr/afridiacritics.yaml' 2026-09-01T00:40:17,881 adding 'lm_eval/tasks/afrobench/adr/gen_utils.py' 2026-09-01T00:40:17,882 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml' 2026-09-01T00:40:17,884 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml' 2026-09-01T00:40:17,885 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml' 2026-09-01T00:40:17,886 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml' 2026-09-01T00:40:17,887 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml' 2026-09-01T00:40:17,888 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml' 2026-09-01T00:40:17,890 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml' 2026-09-01T00:40:17,891 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml' 2026-09-01T00:40:17,893 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml' 2026-09-01T00:40:17,894 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml' 2026-09-01T00:40:17,895 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml' 2026-09-01T00:40:17,896 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml' 2026-09-01T00:40:17,898 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml' 2026-09-01T00:40:17,899 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml' 2026-09-01T00:40:17,900 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml' 2026-09-01T00:40:17,902 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml' 2026-09-01T00:40:17,903 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml' 2026-09-01T00:40:17,904 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml' 2026-09-01T00:40:17,905 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml' 2026-09-01T00:40:17,907 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml' 2026-09-01T00:40:17,908 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml' 2026-09-01T00:40:17,909 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml' 2026-09-01T00:40:17,910 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml' 2026-09-01T00:40:17,911 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml' 2026-09-01T00:40:17,913 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml' 2026-09-01T00:40:17,914 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml' 2026-09-01T00:40:17,915 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml' 2026-09-01T00:40:17,917 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml' 2026-09-01T00:40:17,918 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml' 2026-09-01T00:40:17,919 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml' 2026-09-01T00:40:17,921 adding 'lm_eval/tasks/afrobench/afriqa/README.md' 2026-09-01T00:40:17,922 adding 'lm_eval/tasks/afrobench/afriqa/afriqa.yaml' 2026-09-01T00:40:17,924 adding 'lm_eval/tasks/afrobench/afriqa/utils.py' 2026-09-01T00:40:17,926 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa' 2026-09-01T00:40:17,927 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml' 2026-09-01T00:40:17,928 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml' 2026-09-01T00:40:17,929 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml' 2026-09-01T00:40:17,930 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml' 2026-09-01T00:40:17,931 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml' 2026-09-01T00:40:17,933 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml' 2026-09-01T00:40:17,934 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml' 2026-09-01T00:40:17,935 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml' 2026-09-01T00:40:17,936 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml' 2026-09-01T00:40:17,938 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py' 2026-09-01T00:40:17,940 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa' 2026-09-01T00:40:17,941 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml' 2026-09-01T00:40:17,942 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml' 2026-09-01T00:40:17,943 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml' 2026-09-01T00:40:17,945 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml' 2026-09-01T00:40:17,946 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml' 2026-09-01T00:40:17,947 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml' 2026-09-01T00:40:17,948 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml' 2026-09-01T00:40:17,949 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml' 2026-09-01T00:40:17,951 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml' 2026-09-01T00:40:17,952 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py' 2026-09-01T00:40:17,954 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa' 2026-09-01T00:40:17,955 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml' 2026-09-01T00:40:17,956 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml' 2026-09-01T00:40:17,958 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml' 2026-09-01T00:40:17,959 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml' 2026-09-01T00:40:17,960 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml' 2026-09-01T00:40:17,961 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml' 2026-09-01T00:40:17,962 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml' 2026-09-01T00:40:17,963 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml' 2026-09-01T00:40:17,964 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml' 2026-09-01T00:40:17,966 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py' 2026-09-01T00:40:17,967 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa' 2026-09-01T00:40:17,969 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml' 2026-09-01T00:40:17,970 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml' 2026-09-01T00:40:17,971 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml' 2026-09-01T00:40:17,972 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml' 2026-09-01T00:40:17,973 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml' 2026-09-01T00:40:17,975 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml' 2026-09-01T00:40:17,976 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml' 2026-09-01T00:40:17,977 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml' 2026-09-01T00:40:17,978 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml' 2026-09-01T00:40:17,979 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py' 2026-09-01T00:40:17,981 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa' 2026-09-01T00:40:17,983 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml' 2026-09-01T00:40:17,984 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml' 2026-09-01T00:40:17,985 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml' 2026-09-01T00:40:17,986 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml' 2026-09-01T00:40:17,987 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml' 2026-09-01T00:40:17,988 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml' 2026-09-01T00:40:17,990 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml' 2026-09-01T00:40:17,991 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml' 2026-09-01T00:40:17,992 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml' 2026-09-01T00:40:17,993 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py' 2026-09-01T00:40:17,995 adding 'lm_eval/tasks/afrobench/afrisenti/README.md' 2026-09-01T00:40:17,997 adding 'lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml' 2026-09-01T00:40:17,998 adding 'lm_eval/tasks/afrobench/afrisenti/fewshot.sh' 2026-09-01T00:40:18,000 adding 'lm_eval/tasks/afrobench/afrisenti/utils.py' 2026-09-01T00:40:18,002 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti' 2026-09-01T00:40:18,003 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml' 2026-09-01T00:40:18,004 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml' 2026-09-01T00:40:18,005 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml' 2026-09-01T00:40:18,006 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml' 2026-09-01T00:40:18,007 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml' 2026-09-01T00:40:18,009 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml' 2026-09-01T00:40:18,010 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml' 2026-09-01T00:40:18,011 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml' 2026-09-01T00:40:18,012 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml' 2026-09-01T00:40:18,013 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml' 2026-09-01T00:40:18,015 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml' 2026-09-01T00:40:18,016 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml' 2026-09-01T00:40:18,017 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml' 2026-09-01T00:40:18,019 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml' 2026-09-01T00:40:18,020 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh' 2026-09-01T00:40:18,021 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py' 2026-09-01T00:40:18,022 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py' 2026-09-01T00:40:18,024 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti' 2026-09-01T00:40:18,025 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml' 2026-09-01T00:40:18,026 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml' 2026-09-01T00:40:18,027 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml' 2026-09-01T00:40:18,029 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml' 2026-09-01T00:40:18,030 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml' 2026-09-01T00:40:18,031 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml' 2026-09-01T00:40:18,032 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml' 2026-09-01T00:40:18,033 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml' 2026-09-01T00:40:18,034 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml' 2026-09-01T00:40:18,035 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml' 2026-09-01T00:40:18,036 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml' 2026-09-01T00:40:18,038 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml' 2026-09-01T00:40:18,039 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml' 2026-09-01T00:40:18,040 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml' 2026-09-01T00:40:18,041 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh' 2026-09-01T00:40:18,042 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py' 2026-09-01T00:40:18,043 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py' 2026-09-01T00:40:18,045 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti' 2026-09-01T00:40:18,046 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml' 2026-09-01T00:40:18,048 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml' 2026-09-01T00:40:18,049 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml' 2026-09-01T00:40:18,050 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml' 2026-09-01T00:40:18,051 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml' 2026-09-01T00:40:18,052 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml' 2026-09-01T00:40:18,054 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml' 2026-09-01T00:40:18,055 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml' 2026-09-01T00:40:18,056 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml' 2026-09-01T00:40:18,057 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml' 2026-09-01T00:40:18,058 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml' 2026-09-01T00:40:18,059 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml' 2026-09-01T00:40:18,061 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml' 2026-09-01T00:40:18,062 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml' 2026-09-01T00:40:18,063 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py' 2026-09-01T00:40:18,064 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py' 2026-09-01T00:40:18,066 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti' 2026-09-01T00:40:18,068 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml' 2026-09-01T00:40:18,069 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml' 2026-09-01T00:40:18,070 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml' 2026-09-01T00:40:18,071 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml' 2026-09-01T00:40:18,072 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml' 2026-09-01T00:40:18,073 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml' 2026-09-01T00:40:18,074 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml' 2026-09-01T00:40:18,075 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml' 2026-09-01T00:40:18,077 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml' 2026-09-01T00:40:18,078 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml' 2026-09-01T00:40:18,079 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml' 2026-09-01T00:40:18,080 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml' 2026-09-01T00:40:18,081 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml' 2026-09-01T00:40:18,083 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml' 2026-09-01T00:40:18,084 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py' 2026-09-01T00:40:18,085 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py' 2026-09-01T00:40:18,087 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti' 2026-09-01T00:40:18,088 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml' 2026-09-01T00:40:18,089 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml' 2026-09-01T00:40:18,091 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml' 2026-09-01T00:40:18,092 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml' 2026-09-01T00:40:18,093 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml' 2026-09-01T00:40:18,094 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml' 2026-09-01T00:40:18,096 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml' 2026-09-01T00:40:18,097 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml' 2026-09-01T00:40:18,098 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml' 2026-09-01T00:40:18,100 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml' 2026-09-01T00:40:18,101 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml' 2026-09-01T00:40:18,102 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml' 2026-09-01T00:40:18,104 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml' 2026-09-01T00:40:18,105 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml' 2026-09-01T00:40:18,106 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py' 2026-09-01T00:40:18,107 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py' 2026-09-01T00:40:18,109 adding 'lm_eval/tasks/afrobench/belebele/README.md' 2026-09-01T00:40:18,111 adding 'lm_eval/tasks/afrobench/belebele/belebele.yaml' 2026-09-01T00:40:18,112 adding 'lm_eval/tasks/afrobench/belebele/utils.py' 2026-09-01T00:40:18,114 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele' 2026-09-01T00:40:18,116 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml' 2026-09-01T00:40:18,117 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml' 2026-09-01T00:40:18,118 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml' 2026-09-01T00:40:18,120 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml' 2026-09-01T00:40:18,121 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml' 2026-09-01T00:40:18,122 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml' 2026-09-01T00:40:18,123 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml' 2026-09-01T00:40:18,125 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml' 2026-09-01T00:40:18,126 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml' 2026-09-01T00:40:18,127 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml' 2026-09-01T00:40:18,128 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml' 2026-09-01T00:40:18,129 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml' 2026-09-01T00:40:18,130 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml' 2026-09-01T00:40:18,132 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml' 2026-09-01T00:40:18,133 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml' 2026-09-01T00:40:18,134 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml' 2026-09-01T00:40:18,135 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml' 2026-09-01T00:40:18,136 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml' 2026-09-01T00:40:18,138 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml' 2026-09-01T00:40:18,139 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml' 2026-09-01T00:40:18,140 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml' 2026-09-01T00:40:18,141 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml' 2026-09-01T00:40:18,142 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml' 2026-09-01T00:40:18,143 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml' 2026-09-01T00:40:18,145 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml' 2026-09-01T00:40:18,146 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml' 2026-09-01T00:40:18,147 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml' 2026-09-01T00:40:18,148 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml' 2026-09-01T00:40:18,149 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml' 2026-09-01T00:40:18,151 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml' 2026-09-01T00:40:18,152 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml' 2026-09-01T00:40:18,154 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele' 2026-09-01T00:40:18,156 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml' 2026-09-01T00:40:18,157 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml' 2026-09-01T00:40:18,158 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml' 2026-09-01T00:40:18,159 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml' 2026-09-01T00:40:18,161 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml' 2026-09-01T00:40:18,162 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml' 2026-09-01T00:40:18,163 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml' 2026-09-01T00:40:18,164 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml' 2026-09-01T00:40:18,165 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml' 2026-09-01T00:40:18,167 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml' 2026-09-01T00:40:18,168 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml' 2026-09-01T00:40:18,169 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml' 2026-09-01T00:40:18,170 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml' 2026-09-01T00:40:18,171 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml' 2026-09-01T00:40:18,173 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml' 2026-09-01T00:40:18,174 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml' 2026-09-01T00:40:18,175 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml' 2026-09-01T00:40:18,176 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml' 2026-09-01T00:40:18,178 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml' 2026-09-01T00:40:18,179 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml' 2026-09-01T00:40:18,180 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml' 2026-09-01T00:40:18,181 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml' 2026-09-01T00:40:18,182 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml' 2026-09-01T00:40:18,183 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml' 2026-09-01T00:40:18,184 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml' 2026-09-01T00:40:18,185 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml' 2026-09-01T00:40:18,186 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml' 2026-09-01T00:40:18,188 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml' 2026-09-01T00:40:18,189 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml' 2026-09-01T00:40:18,190 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml' 2026-09-01T00:40:18,191 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml' 2026-09-01T00:40:18,193 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele' 2026-09-01T00:40:18,194 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml' 2026-09-01T00:40:18,196 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml' 2026-09-01T00:40:18,197 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml' 2026-09-01T00:40:18,198 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml' 2026-09-01T00:40:18,199 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml' 2026-09-01T00:40:18,200 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml' 2026-09-01T00:40:18,201 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml' 2026-09-01T00:40:18,203 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml' 2026-09-01T00:40:18,204 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml' 2026-09-01T00:40:18,205 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml' 2026-09-01T00:40:18,206 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml' 2026-09-01T00:40:18,207 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml' 2026-09-01T00:40:18,209 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml' 2026-09-01T00:40:18,210 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml' 2026-09-01T00:40:18,211 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml' 2026-09-01T00:40:18,212 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml' 2026-09-01T00:40:18,213 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml' 2026-09-01T00:40:18,214 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml' 2026-09-01T00:40:18,216 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml' 2026-09-01T00:40:18,217 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml' 2026-09-01T00:40:18,218 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml' 2026-09-01T00:40:18,219 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml' 2026-09-01T00:40:18,220 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml' 2026-09-01T00:40:18,222 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml' 2026-09-01T00:40:18,223 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml' 2026-09-01T00:40:18,224 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml' 2026-09-01T00:40:18,225 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml' 2026-09-01T00:40:18,227 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml' 2026-09-01T00:40:18,228 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml' 2026-09-01T00:40:18,229 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml' 2026-09-01T00:40:18,230 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml' 2026-09-01T00:40:18,233 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele' 2026-09-01T00:40:18,234 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml' 2026-09-01T00:40:18,235 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml' 2026-09-01T00:40:18,236 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml' 2026-09-01T00:40:18,237 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml' 2026-09-01T00:40:18,238 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml' 2026-09-01T00:40:18,239 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml' 2026-09-01T00:40:18,241 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml' 2026-09-01T00:40:18,242 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml' 2026-09-01T00:40:18,243 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml' 2026-09-01T00:40:18,244 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml' 2026-09-01T00:40:18,245 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml' 2026-09-01T00:40:18,246 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml' 2026-09-01T00:40:18,248 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml' 2026-09-01T00:40:18,249 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml' 2026-09-01T00:40:18,250 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml' 2026-09-01T00:40:18,251 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml' 2026-09-01T00:40:18,252 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml' 2026-09-01T00:40:18,253 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml' 2026-09-01T00:40:18,254 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml' 2026-09-01T00:40:18,256 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml' 2026-09-01T00:40:18,257 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml' 2026-09-01T00:40:18,258 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml' 2026-09-01T00:40:18,259 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml' 2026-09-01T00:40:18,260 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml' 2026-09-01T00:40:18,261 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml' 2026-09-01T00:40:18,263 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml' 2026-09-01T00:40:18,264 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml' 2026-09-01T00:40:18,265 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml' 2026-09-01T00:40:18,266 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml' 2026-09-01T00:40:18,267 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml' 2026-09-01T00:40:18,269 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml' 2026-09-01T00:40:18,271 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele' 2026-09-01T00:40:18,272 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml' 2026-09-01T00:40:18,273 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml' 2026-09-01T00:40:18,275 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml' 2026-09-01T00:40:18,276 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml' 2026-09-01T00:40:18,277 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml' 2026-09-01T00:40:18,279 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml' 2026-09-01T00:40:18,280 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml' 2026-09-01T00:40:18,281 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml' 2026-09-01T00:40:18,282 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml' 2026-09-01T00:40:18,284 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml' 2026-09-01T00:40:18,285 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml' 2026-09-01T00:40:18,286 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml' 2026-09-01T00:40:18,287 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml' 2026-09-01T00:40:18,288 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml' 2026-09-01T00:40:18,289 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml' 2026-09-01T00:40:18,290 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml' 2026-09-01T00:40:18,292 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml' 2026-09-01T00:40:18,293 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml' 2026-09-01T00:40:18,294 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml' 2026-09-01T00:40:18,295 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml' 2026-09-01T00:40:18,296 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml' 2026-09-01T00:40:18,298 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml' 2026-09-01T00:40:18,299 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml' 2026-09-01T00:40:18,300 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml' 2026-09-01T00:40:18,301 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml' 2026-09-01T00:40:18,302 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml' 2026-09-01T00:40:18,303 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml' 2026-09-01T00:40:18,305 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml' 2026-09-01T00:40:18,306 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml' 2026-09-01T00:40:18,307 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml' 2026-09-01T00:40:18,308 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml' 2026-09-01T00:40:18,310 adding 'lm_eval/tasks/afrobench/flores/README.md' 2026-09-01T00:40:18,312 adding 'lm_eval/tasks/afrobench/flores/flores.yaml' 2026-09-01T00:40:18,313 adding 'lm_eval/tasks/afrobench/flores/gen_utils.py' 2026-09-01T00:40:18,315 adding 'lm_eval/tasks/afrobench/flores/prompt_1/flores' 2026-09-01T00:40:18,318 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores' 2026-09-01T00:40:18,319 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,320 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,321 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,323 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,324 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,325 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,326 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:40:18,328 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,329 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,330 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,331 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,332 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,334 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,335 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,336 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,337 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,338 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,339 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,340 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,342 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,343 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,344 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,345 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,346 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,347 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,348 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,350 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,351 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,352 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,353 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,354 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,355 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,356 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,358 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,359 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,360 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,361 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,362 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,363 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,364 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,366 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,367 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,368 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,369 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,370 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,372 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,373 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,374 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,375 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,377 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,378 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-09-01T00:40:18,379 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:40:18,380 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,381 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,382 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,383 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,385 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-09-01T00:40:18,386 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,387 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,388 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,389 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,390 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,393 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores' 2026-09-01T00:40:18,394 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-09-01T00:40:18,396 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-09-01T00:40:18,397 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-09-01T00:40:18,398 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-09-01T00:40:18,399 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-09-01T00:40:18,400 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-09-01T00:40:18,401 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:40:18,403 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-09-01T00:40:18,404 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-09-01T00:40:18,405 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-09-01T00:40:18,407 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-09-01T00:40:18,408 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-09-01T00:40:18,409 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-09-01T00:40:18,410 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-09-01T00:40:18,412 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-09-01T00:40:18,413 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:40:18,414 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-09-01T00:40:18,416 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-09-01T00:40:18,417 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-09-01T00:40:18,418 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-09-01T00:40:18,419 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-09-01T00:40:18,420 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:40:18,422 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-09-01T00:40:18,423 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-09-01T00:40:18,424 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-09-01T00:40:18,425 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-09-01T00:40:18,426 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-09-01T00:40:18,427 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-09-01T00:40:18,428 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-09-01T00:40:18,430 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-09-01T00:40:18,431 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-09-01T00:40:18,432 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-09-01T00:40:18,433 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-09-01T00:40:18,434 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-09-01T00:40:18,435 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-09-01T00:40:18,437 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-09-01T00:40:18,438 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-09-01T00:40:18,439 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-09-01T00:40:18,440 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-09-01T00:40:18,441 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-09-01T00:40:18,442 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-09-01T00:40:18,444 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml' 2026-09-01T00:40:18,445 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-09-01T00:40:18,446 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-09-01T00:40:18,447 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml' 2026-09-01T00:40:18,449 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-09-01T00:40:18,450 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:40:18,451 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-09-01T00:40:18,453 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-09-01T00:40:18,454 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-09-01T00:40:18,455 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-09-01T00:40:18,457 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:40:18,458 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:40:18,459 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-09-01T00:40:18,460 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-09-01T00:40:18,461 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-09-01T00:40:18,462 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-09-01T00:40:18,464 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-09-01T00:40:18,465 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-09-01T00:40:18,466 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-09-01T00:40:18,467 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-09-01T00:40:18,468 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-09-01T00:40:18,470 adding 'lm_eval/tasks/afrobench/flores/prompt_2/flores' 2026-09-01T00:40:18,473 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores' 2026-09-01T00:40:18,474 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,475 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,476 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,477 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,479 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,480 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,481 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:40:18,482 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,483 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,484 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,486 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,487 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,488 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,490 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,491 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,492 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,493 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,495 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,496 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,498 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,499 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,501 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,502 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,504 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,505 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,506 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,507 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,508 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,509 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,510 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,512 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,513 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,514 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,515 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,516 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,517 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,518 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,520 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,521 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,522 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,523 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,524 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,525 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,527 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,528 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,529 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,530 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,531 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,533 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,534 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,535 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-09-01T00:40:18,536 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:40:18,537 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,538 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,540 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,541 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,542 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-09-01T00:40:18,543 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,544 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,546 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,547 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,548 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,551 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores' 2026-09-01T00:40:18,552 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-09-01T00:40:18,553 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-09-01T00:40:18,554 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-09-01T00:40:18,556 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-09-01T00:40:18,557 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-09-01T00:40:18,558 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-09-01T00:40:18,559 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:40:18,560 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-09-01T00:40:18,561 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-09-01T00:40:18,562 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-09-01T00:40:18,563 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-09-01T00:40:18,565 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-09-01T00:40:18,566 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-09-01T00:40:18,567 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-09-01T00:40:18,568 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-09-01T00:40:18,569 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:40:18,571 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-09-01T00:40:18,572 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-09-01T00:40:18,573 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-09-01T00:40:18,574 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-09-01T00:40:18,576 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-09-01T00:40:18,577 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:40:18,578 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-09-01T00:40:18,579 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-09-01T00:40:18,580 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-09-01T00:40:18,581 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-09-01T00:40:18,583 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-09-01T00:40:18,584 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-09-01T00:40:18,585 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-09-01T00:40:18,587 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-09-01T00:40:18,588 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-09-01T00:40:18,589 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-09-01T00:40:18,590 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-09-01T00:40:18,591 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-09-01T00:40:18,592 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-09-01T00:40:18,593 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-09-01T00:40:18,595 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-09-01T00:40:18,596 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-09-01T00:40:18,597 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-09-01T00:40:18,598 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-09-01T00:40:18,599 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-09-01T00:40:18,600 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml' 2026-09-01T00:40:18,602 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-09-01T00:40:18,603 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-09-01T00:40:18,604 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml' 2026-09-01T00:40:18,605 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-09-01T00:40:18,606 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:40:18,608 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-09-01T00:40:18,609 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-09-01T00:40:18,610 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-09-01T00:40:18,611 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-09-01T00:40:18,612 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:40:18,614 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:40:18,615 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-09-01T00:40:18,616 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-09-01T00:40:18,617 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-09-01T00:40:18,618 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-09-01T00:40:18,620 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-09-01T00:40:18,621 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-09-01T00:40:18,622 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-09-01T00:40:18,623 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-09-01T00:40:18,625 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-09-01T00:40:18,626 adding 'lm_eval/tasks/afrobench/flores/prompt_3/flores' 2026-09-01T00:40:18,629 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores' 2026-09-01T00:40:18,630 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,631 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,632 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,633 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,634 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,636 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,637 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:40:18,638 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,639 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,640 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,641 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,642 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,644 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,645 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,646 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,647 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,648 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,649 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,651 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,652 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,653 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,654 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,656 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,657 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,658 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,659 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,660 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,661 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,663 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,664 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-09-01T00:40:18,665 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,666 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,667 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,668 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,670 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,671 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,672 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,673 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,674 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,675 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,676 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,677 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,679 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,680 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,681 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,682 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,683 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,684 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,686 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,687 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,688 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-09-01T00:40:18,689 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:40:18,690 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,691 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,693 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,694 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,695 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-09-01T00:40:18,696 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,698 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,699 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,700 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,702 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-09-01T00:40:18,704 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores' 2026-09-01T00:40:18,706 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-09-01T00:40:18,707 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-09-01T00:40:18,708 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-09-01T00:40:18,709 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-09-01T00:40:18,710 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-09-01T00:40:18,712 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-09-01T00:40:18,713 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:40:18,714 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-09-01T00:40:18,715 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-09-01T00:40:18,716 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-09-01T00:40:18,717 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-09-01T00:40:18,718 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-09-01T00:40:18,719 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-09-01T00:40:18,721 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-09-01T00:40:18,722 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-09-01T00:40:18,723 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:40:18,724 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-09-01T00:40:18,725 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-09-01T00:40:18,726 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-09-01T00:40:18,728 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-09-01T00:40:18,729 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-09-01T00:40:18,730 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:40:18,731 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-09-01T00:40:18,732 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-09-01T00:40:18,734 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-09-01T00:40:18,735 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-09-01T00:40:18,736 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-09-01T00:40:18,737 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-09-01T00:40:18,738 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-09-01T00:40:18,739 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-09-01T00:40:18,741 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-09-01T00:40:18,742 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-09-01T00:40:18,743 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-09-01T00:40:18,744 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-09-01T00:40:18,745 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-09-01T00:40:18,747 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-09-01T00:40:18,748 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-09-01T00:40:18,749 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-09-01T00:40:18,750 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-09-01T00:40:18,751 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-09-01T00:40:18,752 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-09-01T00:40:18,753 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml' 2026-09-01T00:40:18,755 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-09-01T00:40:18,756 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-09-01T00:40:18,757 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml' 2026-09-01T00:40:18,758 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-09-01T00:40:18,759 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:40:18,760 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-09-01T00:40:18,761 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-09-01T00:40:18,763 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-09-01T00:40:18,764 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-09-01T00:40:18,765 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:40:18,766 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:40:18,767 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-09-01T00:40:18,768 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-09-01T00:40:18,770 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-09-01T00:40:18,771 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-09-01T00:40:18,772 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-09-01T00:40:18,773 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-09-01T00:40:18,774 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-09-01T00:40:18,776 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-09-01T00:40:18,777 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-09-01T00:40:18,779 adding 'lm_eval/tasks/afrobench/injongointent/README.md' 2026-09-01T00:40:18,780 adding 'lm_eval/tasks/afrobench/injongointent/gen_utils.py' 2026-09-01T00:40:18,782 adding 'lm_eval/tasks/afrobench/injongointent/injongointent.yaml' 2026-09-01T00:40:18,784 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent' 2026-09-01T00:40:18,785 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml' 2026-09-01T00:40:18,786 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml' 2026-09-01T00:40:18,787 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml' 2026-09-01T00:40:18,789 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml' 2026-09-01T00:40:18,790 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml' 2026-09-01T00:40:18,791 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml' 2026-09-01T00:40:18,793 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml' 2026-09-01T00:40:18,794 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml' 2026-09-01T00:40:18,795 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml' 2026-09-01T00:40:18,796 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml' 2026-09-01T00:40:18,797 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml' 2026-09-01T00:40:18,799 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml' 2026-09-01T00:40:18,800 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml' 2026-09-01T00:40:18,801 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml' 2026-09-01T00:40:18,802 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml' 2026-09-01T00:40:18,803 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml' 2026-09-01T00:40:18,805 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml' 2026-09-01T00:40:18,806 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py' 2026-09-01T00:40:18,808 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent' 2026-09-01T00:40:18,809 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml' 2026-09-01T00:40:18,810 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml' 2026-09-01T00:40:18,812 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml' 2026-09-01T00:40:18,813 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml' 2026-09-01T00:40:18,814 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml' 2026-09-01T00:40:18,815 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml' 2026-09-01T00:40:18,817 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml' 2026-09-01T00:40:18,818 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml' 2026-09-01T00:40:18,819 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml' 2026-09-01T00:40:18,820 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml' 2026-09-01T00:40:18,822 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml' 2026-09-01T00:40:18,823 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml' 2026-09-01T00:40:18,824 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml' 2026-09-01T00:40:18,825 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml' 2026-09-01T00:40:18,827 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml' 2026-09-01T00:40:18,828 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml' 2026-09-01T00:40:18,829 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml' 2026-09-01T00:40:18,831 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py' 2026-09-01T00:40:18,833 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent' 2026-09-01T00:40:18,834 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml' 2026-09-01T00:40:18,835 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml' 2026-09-01T00:40:18,837 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml' 2026-09-01T00:40:18,838 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml' 2026-09-01T00:40:18,839 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml' 2026-09-01T00:40:18,841 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml' 2026-09-01T00:40:18,842 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml' 2026-09-01T00:40:18,843 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml' 2026-09-01T00:40:18,844 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml' 2026-09-01T00:40:18,846 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml' 2026-09-01T00:40:18,847 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml' 2026-09-01T00:40:18,848 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml' 2026-09-01T00:40:18,849 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml' 2026-09-01T00:40:18,851 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml' 2026-09-01T00:40:18,852 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml' 2026-09-01T00:40:18,853 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml' 2026-09-01T00:40:18,854 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml' 2026-09-01T00:40:18,856 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py' 2026-09-01T00:40:18,858 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent' 2026-09-01T00:40:18,859 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml' 2026-09-01T00:40:18,860 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml' 2026-09-01T00:40:18,861 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml' 2026-09-01T00:40:18,863 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml' 2026-09-01T00:40:18,864 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml' 2026-09-01T00:40:18,865 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml' 2026-09-01T00:40:18,866 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml' 2026-09-01T00:40:18,868 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml' 2026-09-01T00:40:18,869 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml' 2026-09-01T00:40:18,870 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml' 2026-09-01T00:40:18,871 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml' 2026-09-01T00:40:18,873 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml' 2026-09-01T00:40:18,874 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml' 2026-09-01T00:40:18,875 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml' 2026-09-01T00:40:18,877 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml' 2026-09-01T00:40:18,878 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml' 2026-09-01T00:40:18,879 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml' 2026-09-01T00:40:18,880 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py' 2026-09-01T00:40:18,882 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent' 2026-09-01T00:40:18,883 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml' 2026-09-01T00:40:18,885 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml' 2026-09-01T00:40:18,886 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml' 2026-09-01T00:40:18,887 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml' 2026-09-01T00:40:18,888 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml' 2026-09-01T00:40:18,890 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml' 2026-09-01T00:40:18,891 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml' 2026-09-01T00:40:18,892 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml' 2026-09-01T00:40:18,893 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml' 2026-09-01T00:40:18,895 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml' 2026-09-01T00:40:18,896 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml' 2026-09-01T00:40:18,897 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml' 2026-09-01T00:40:18,898 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml' 2026-09-01T00:40:18,899 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml' 2026-09-01T00:40:18,901 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml' 2026-09-01T00:40:18,902 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml' 2026-09-01T00:40:18,903 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml' 2026-09-01T00:40:18,904 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py' 2026-09-01T00:40:18,906 adding 'lm_eval/tasks/afrobench/mafand/README.md' 2026-09-01T00:40:18,908 adding 'lm_eval/tasks/afrobench/mafand/gen_utils.py' 2026-09-01T00:40:18,909 adding 'lm_eval/tasks/afrobench/mafand/mafand.yaml' 2026-09-01T00:40:18,911 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand' 2026-09-01T00:40:18,912 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml' 2026-09-01T00:40:18,914 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml' 2026-09-01T00:40:18,915 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml' 2026-09-01T00:40:18,916 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml' 2026-09-01T00:40:18,917 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml' 2026-09-01T00:40:18,918 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml' 2026-09-01T00:40:18,919 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml' 2026-09-01T00:40:18,920 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml' 2026-09-01T00:40:18,922 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml' 2026-09-01T00:40:18,923 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml' 2026-09-01T00:40:18,924 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml' 2026-09-01T00:40:18,925 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml' 2026-09-01T00:40:18,926 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml' 2026-09-01T00:40:18,927 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml' 2026-09-01T00:40:18,928 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml' 2026-09-01T00:40:18,930 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml' 2026-09-01T00:40:18,931 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml' 2026-09-01T00:40:18,932 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml' 2026-09-01T00:40:18,933 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml' 2026-09-01T00:40:18,934 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml' 2026-09-01T00:40:18,935 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml' 2026-09-01T00:40:18,937 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py' 2026-09-01T00:40:18,939 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand' 2026-09-01T00:40:18,940 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml' 2026-09-01T00:40:18,941 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml' 2026-09-01T00:40:18,942 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml' 2026-09-01T00:40:18,944 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml' 2026-09-01T00:40:18,945 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml' 2026-09-01T00:40:18,946 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml' 2026-09-01T00:40:18,947 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml' 2026-09-01T00:40:18,948 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml' 2026-09-01T00:40:18,949 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml' 2026-09-01T00:40:18,950 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml' 2026-09-01T00:40:18,951 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml' 2026-09-01T00:40:18,952 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml' 2026-09-01T00:40:18,953 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml' 2026-09-01T00:40:18,954 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml' 2026-09-01T00:40:18,956 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml' 2026-09-01T00:40:18,957 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml' 2026-09-01T00:40:18,958 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml' 2026-09-01T00:40:18,959 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml' 2026-09-01T00:40:18,960 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml' 2026-09-01T00:40:18,961 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml' 2026-09-01T00:40:18,962 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml' 2026-09-01T00:40:18,963 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py' 2026-09-01T00:40:18,966 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand' 2026-09-01T00:40:18,967 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml' 2026-09-01T00:40:18,969 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml' 2026-09-01T00:40:18,970 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml' 2026-09-01T00:40:18,971 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml' 2026-09-01T00:40:18,972 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml' 2026-09-01T00:40:18,973 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml' 2026-09-01T00:40:18,974 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml' 2026-09-01T00:40:18,975 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml' 2026-09-01T00:40:18,976 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml' 2026-09-01T00:40:18,978 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml' 2026-09-01T00:40:18,979 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml' 2026-09-01T00:40:18,980 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml' 2026-09-01T00:40:18,981 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml' 2026-09-01T00:40:18,982 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml' 2026-09-01T00:40:18,983 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml' 2026-09-01T00:40:18,985 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml' 2026-09-01T00:40:18,986 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml' 2026-09-01T00:40:18,987 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml' 2026-09-01T00:40:18,988 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml' 2026-09-01T00:40:18,989 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml' 2026-09-01T00:40:18,990 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml' 2026-09-01T00:40:18,991 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py' 2026-09-01T00:40:18,993 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand' 2026-09-01T00:40:18,994 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml' 2026-09-01T00:40:18,996 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml' 2026-09-01T00:40:18,997 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml' 2026-09-01T00:40:18,998 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml' 2026-09-01T00:40:18,999 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml' 2026-09-01T00:40:19,000 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml' 2026-09-01T00:40:19,001 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml' 2026-09-01T00:40:19,002 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml' 2026-09-01T00:40:19,003 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml' 2026-09-01T00:40:19,004 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml' 2026-09-01T00:40:19,005 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml' 2026-09-01T00:40:19,007 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml' 2026-09-01T00:40:19,008 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml' 2026-09-01T00:40:19,009 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml' 2026-09-01T00:40:19,010 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml' 2026-09-01T00:40:19,011 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml' 2026-09-01T00:40:19,012 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml' 2026-09-01T00:40:19,013 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml' 2026-09-01T00:40:19,014 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml' 2026-09-01T00:40:19,016 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml' 2026-09-01T00:40:19,017 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml' 2026-09-01T00:40:19,018 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py' 2026-09-01T00:40:19,021 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand' 2026-09-01T00:40:19,022 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml' 2026-09-01T00:40:19,023 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml' 2026-09-01T00:40:19,024 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml' 2026-09-01T00:40:19,025 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml' 2026-09-01T00:40:19,027 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml' 2026-09-01T00:40:19,028 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml' 2026-09-01T00:40:19,029 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml' 2026-09-01T00:40:19,030 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml' 2026-09-01T00:40:19,031 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml' 2026-09-01T00:40:19,032 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml' 2026-09-01T00:40:19,033 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml' 2026-09-01T00:40:19,034 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml' 2026-09-01T00:40:19,036 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml' 2026-09-01T00:40:19,037 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml' 2026-09-01T00:40:19,038 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml' 2026-09-01T00:40:19,039 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml' 2026-09-01T00:40:19,040 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml' 2026-09-01T00:40:19,041 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml' 2026-09-01T00:40:19,042 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml' 2026-09-01T00:40:19,043 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml' 2026-09-01T00:40:19,044 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml' 2026-09-01T00:40:19,046 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py' 2026-09-01T00:40:19,048 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand' 2026-09-01T00:40:19,049 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml' 2026-09-01T00:40:19,050 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml' 2026-09-01T00:40:19,051 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml' 2026-09-01T00:40:19,052 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml' 2026-09-01T00:40:19,053 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml' 2026-09-01T00:40:19,054 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml' 2026-09-01T00:40:19,056 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml' 2026-09-01T00:40:19,057 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml' 2026-09-01T00:40:19,058 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml' 2026-09-01T00:40:19,059 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml' 2026-09-01T00:40:19,060 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml' 2026-09-01T00:40:19,061 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml' 2026-09-01T00:40:19,062 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml' 2026-09-01T00:40:19,063 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml' 2026-09-01T00:40:19,065 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml' 2026-09-01T00:40:19,066 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml' 2026-09-01T00:40:19,067 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml' 2026-09-01T00:40:19,068 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml' 2026-09-01T00:40:19,069 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml' 2026-09-01T00:40:19,070 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml' 2026-09-01T00:40:19,071 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml' 2026-09-01T00:40:19,073 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py' 2026-09-01T00:40:19,075 adding 'lm_eval/tasks/afrobench/masakhaner/README.md' 2026-09-01T00:40:19,077 adding 'lm_eval/tasks/afrobench/masakhaner/gen_utils.py' 2026-09-01T00:40:19,078 adding 'lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml' 2026-09-01T00:40:19,080 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner' 2026-09-01T00:40:19,081 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml' 2026-09-01T00:40:19,082 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml' 2026-09-01T00:40:19,083 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml' 2026-09-01T00:40:19,084 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml' 2026-09-01T00:40:19,085 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml' 2026-09-01T00:40:19,087 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml' 2026-09-01T00:40:19,088 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml' 2026-09-01T00:40:19,089 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml' 2026-09-01T00:40:19,090 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml' 2026-09-01T00:40:19,091 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml' 2026-09-01T00:40:19,093 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml' 2026-09-01T00:40:19,094 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml' 2026-09-01T00:40:19,095 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml' 2026-09-01T00:40:19,096 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml' 2026-09-01T00:40:19,097 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml' 2026-09-01T00:40:19,098 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml' 2026-09-01T00:40:19,100 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml' 2026-09-01T00:40:19,101 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml' 2026-09-01T00:40:19,102 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml' 2026-09-01T00:40:19,103 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml' 2026-09-01T00:40:19,105 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py' 2026-09-01T00:40:19,107 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner' 2026-09-01T00:40:19,108 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml' 2026-09-01T00:40:19,109 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml' 2026-09-01T00:40:19,110 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml' 2026-09-01T00:40:19,112 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml' 2026-09-01T00:40:19,113 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml' 2026-09-01T00:40:19,114 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml' 2026-09-01T00:40:19,116 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml' 2026-09-01T00:40:19,117 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml' 2026-09-01T00:40:19,118 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml' 2026-09-01T00:40:19,119 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml' 2026-09-01T00:40:19,120 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml' 2026-09-01T00:40:19,122 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml' 2026-09-01T00:40:19,123 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml' 2026-09-01T00:40:19,124 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml' 2026-09-01T00:40:19,125 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml' 2026-09-01T00:40:19,127 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml' 2026-09-01T00:40:19,128 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml' 2026-09-01T00:40:19,129 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml' 2026-09-01T00:40:19,130 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml' 2026-09-01T00:40:19,132 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml' 2026-09-01T00:40:19,133 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py' 2026-09-01T00:40:19,135 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner' 2026-09-01T00:40:19,136 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml' 2026-09-01T00:40:19,137 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml' 2026-09-01T00:40:19,138 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml' 2026-09-01T00:40:19,139 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml' 2026-09-01T00:40:19,141 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml' 2026-09-01T00:40:19,142 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml' 2026-09-01T00:40:19,143 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml' 2026-09-01T00:40:19,144 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml' 2026-09-01T00:40:19,145 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml' 2026-09-01T00:40:19,147 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml' 2026-09-01T00:40:19,148 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml' 2026-09-01T00:40:19,149 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml' 2026-09-01T00:40:19,150 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml' 2026-09-01T00:40:19,151 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml' 2026-09-01T00:40:19,153 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml' 2026-09-01T00:40:19,154 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml' 2026-09-01T00:40:19,155 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml' 2026-09-01T00:40:19,157 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml' 2026-09-01T00:40:19,158 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml' 2026-09-01T00:40:19,159 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml' 2026-09-01T00:40:19,160 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py' 2026-09-01T00:40:19,162 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner' 2026-09-01T00:40:19,164 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml' 2026-09-01T00:40:19,165 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml' 2026-09-01T00:40:19,166 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml' 2026-09-01T00:40:19,167 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml' 2026-09-01T00:40:19,169 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml' 2026-09-01T00:40:19,170 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml' 2026-09-01T00:40:19,171 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml' 2026-09-01T00:40:19,172 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml' 2026-09-01T00:40:19,173 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml' 2026-09-01T00:40:19,175 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml' 2026-09-01T00:40:19,176 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml' 2026-09-01T00:40:19,177 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml' 2026-09-01T00:40:19,178 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml' 2026-09-01T00:40:19,180 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml' 2026-09-01T00:40:19,181 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml' 2026-09-01T00:40:19,182 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml' 2026-09-01T00:40:19,183 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml' 2026-09-01T00:40:19,185 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml' 2026-09-01T00:40:19,186 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml' 2026-09-01T00:40:19,187 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml' 2026-09-01T00:40:19,188 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py' 2026-09-01T00:40:19,190 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner' 2026-09-01T00:40:19,191 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml' 2026-09-01T00:40:19,192 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml' 2026-09-01T00:40:19,193 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml' 2026-09-01T00:40:19,195 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml' 2026-09-01T00:40:19,196 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml' 2026-09-01T00:40:19,197 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml' 2026-09-01T00:40:19,198 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml' 2026-09-01T00:40:19,199 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml' 2026-09-01T00:40:19,201 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml' 2026-09-01T00:40:19,202 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml' 2026-09-01T00:40:19,203 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml' 2026-09-01T00:40:19,204 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml' 2026-09-01T00:40:19,205 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml' 2026-09-01T00:40:19,206 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml' 2026-09-01T00:40:19,208 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml' 2026-09-01T00:40:19,209 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml' 2026-09-01T00:40:19,210 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml' 2026-09-01T00:40:19,211 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml' 2026-09-01T00:40:19,212 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml' 2026-09-01T00:40:19,214 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml' 2026-09-01T00:40:19,215 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py' 2026-09-01T00:40:19,217 adding 'lm_eval/tasks/afrobench/masakhanews/README.md' 2026-09-01T00:40:19,219 adding 'lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml' 2026-09-01T00:40:19,220 adding 'lm_eval/tasks/afrobench/masakhanews/utils.py' 2026-09-01T00:40:19,222 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews' 2026-09-01T00:40:19,223 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml' 2026-09-01T00:40:19,224 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml' 2026-09-01T00:40:19,226 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml' 2026-09-01T00:40:19,227 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml' 2026-09-01T00:40:19,228 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml' 2026-09-01T00:40:19,229 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml' 2026-09-01T00:40:19,230 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml' 2026-09-01T00:40:19,232 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml' 2026-09-01T00:40:19,233 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml' 2026-09-01T00:40:19,234 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml' 2026-09-01T00:40:19,235 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml' 2026-09-01T00:40:19,236 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml' 2026-09-01T00:40:19,238 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml' 2026-09-01T00:40:19,239 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml' 2026-09-01T00:40:19,240 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml' 2026-09-01T00:40:19,241 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml' 2026-09-01T00:40:19,242 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py' 2026-09-01T00:40:19,243 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews' 2026-09-01T00:40:19,245 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml' 2026-09-01T00:40:19,246 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml' 2026-09-01T00:40:19,247 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml' 2026-09-01T00:40:19,248 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml' 2026-09-01T00:40:19,249 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml' 2026-09-01T00:40:19,251 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml' 2026-09-01T00:40:19,252 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml' 2026-09-01T00:40:19,253 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml' 2026-09-01T00:40:19,254 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml' 2026-09-01T00:40:19,255 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml' 2026-09-01T00:40:19,256 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml' 2026-09-01T00:40:19,258 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml' 2026-09-01T00:40:19,259 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml' 2026-09-01T00:40:19,260 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml' 2026-09-01T00:40:19,261 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml' 2026-09-01T00:40:19,262 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml' 2026-09-01T00:40:19,263 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py' 2026-09-01T00:40:19,265 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews' 2026-09-01T00:40:19,267 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml' 2026-09-01T00:40:19,268 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml' 2026-09-01T00:40:19,269 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml' 2026-09-01T00:40:19,270 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml' 2026-09-01T00:40:19,271 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml' 2026-09-01T00:40:19,273 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml' 2026-09-01T00:40:19,274 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml' 2026-09-01T00:40:19,275 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml' 2026-09-01T00:40:19,276 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml' 2026-09-01T00:40:19,278 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml' 2026-09-01T00:40:19,279 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml' 2026-09-01T00:40:19,280 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml' 2026-09-01T00:40:19,281 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml' 2026-09-01T00:40:19,282 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml' 2026-09-01T00:40:19,284 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml' 2026-09-01T00:40:19,285 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml' 2026-09-01T00:40:19,286 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py' 2026-09-01T00:40:19,288 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews' 2026-09-01T00:40:19,289 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml' 2026-09-01T00:40:19,290 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml' 2026-09-01T00:40:19,291 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml' 2026-09-01T00:40:19,292 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml' 2026-09-01T00:40:19,293 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml' 2026-09-01T00:40:19,294 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml' 2026-09-01T00:40:19,295 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml' 2026-09-01T00:40:19,297 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml' 2026-09-01T00:40:19,298 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml' 2026-09-01T00:40:19,299 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml' 2026-09-01T00:40:19,300 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml' 2026-09-01T00:40:19,302 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml' 2026-09-01T00:40:19,303 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml' 2026-09-01T00:40:19,304 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml' 2026-09-01T00:40:19,305 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml' 2026-09-01T00:40:19,306 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml' 2026-09-01T00:40:19,307 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py' 2026-09-01T00:40:19,309 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews' 2026-09-01T00:40:19,311 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml' 2026-09-01T00:40:19,312 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml' 2026-09-01T00:40:19,313 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml' 2026-09-01T00:40:19,314 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml' 2026-09-01T00:40:19,316 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml' 2026-09-01T00:40:19,317 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml' 2026-09-01T00:40:19,318 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml' 2026-09-01T00:40:19,320 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml' 2026-09-01T00:40:19,321 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml' 2026-09-01T00:40:19,322 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml' 2026-09-01T00:40:19,323 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml' 2026-09-01T00:40:19,325 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml' 2026-09-01T00:40:19,326 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml' 2026-09-01T00:40:19,327 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml' 2026-09-01T00:40:19,328 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml' 2026-09-01T00:40:19,330 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml' 2026-09-01T00:40:19,331 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py' 2026-09-01T00:40:19,333 adding 'lm_eval/tasks/afrobench/masakhapos/README.md' 2026-09-01T00:40:19,335 adding 'lm_eval/tasks/afrobench/masakhapos/gen_utils.py' 2026-09-01T00:40:19,336 adding 'lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml' 2026-09-01T00:40:19,337 adding 'lm_eval/tasks/afrobench/masakhapos/utils.py' 2026-09-01T00:40:19,339 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml' 2026-09-01T00:40:19,341 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml' 2026-09-01T00:40:19,342 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml' 2026-09-01T00:40:19,343 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml' 2026-09-01T00:40:19,344 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml' 2026-09-01T00:40:19,345 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml' 2026-09-01T00:40:19,346 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml' 2026-09-01T00:40:19,348 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml' 2026-09-01T00:40:19,349 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml' 2026-09-01T00:40:19,350 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml' 2026-09-01T00:40:19,351 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml' 2026-09-01T00:40:19,352 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml' 2026-09-01T00:40:19,354 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml' 2026-09-01T00:40:19,355 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml' 2026-09-01T00:40:19,356 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml' 2026-09-01T00:40:19,357 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml' 2026-09-01T00:40:19,358 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml' 2026-09-01T00:40:19,360 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml' 2026-09-01T00:40:19,361 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml' 2026-09-01T00:40:19,362 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml' 2026-09-01T00:40:19,363 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml' 2026-09-01T00:40:19,365 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py' 2026-09-01T00:40:19,367 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml' 2026-09-01T00:40:19,368 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml' 2026-09-01T00:40:19,369 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml' 2026-09-01T00:40:19,370 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml' 2026-09-01T00:40:19,372 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml' 2026-09-01T00:40:19,373 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml' 2026-09-01T00:40:19,374 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml' 2026-09-01T00:40:19,375 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml' 2026-09-01T00:40:19,377 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml' 2026-09-01T00:40:19,378 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml' 2026-09-01T00:40:19,379 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml' 2026-09-01T00:40:19,381 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml' 2026-09-01T00:40:19,382 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml' 2026-09-01T00:40:19,383 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml' 2026-09-01T00:40:19,384 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml' 2026-09-01T00:40:19,386 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml' 2026-09-01T00:40:19,387 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml' 2026-09-01T00:40:19,388 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml' 2026-09-01T00:40:19,389 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml' 2026-09-01T00:40:19,391 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml' 2026-09-01T00:40:19,392 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml' 2026-09-01T00:40:19,393 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py' 2026-09-01T00:40:19,395 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml' 2026-09-01T00:40:19,396 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml' 2026-09-01T00:40:19,397 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml' 2026-09-01T00:40:19,398 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml' 2026-09-01T00:40:19,400 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml' 2026-09-01T00:40:19,401 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml' 2026-09-01T00:40:19,402 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml' 2026-09-01T00:40:19,403 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml' 2026-09-01T00:40:19,404 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml' 2026-09-01T00:40:19,406 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml' 2026-09-01T00:40:19,407 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml' 2026-09-01T00:40:19,408 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml' 2026-09-01T00:40:19,409 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml' 2026-09-01T00:40:19,411 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml' 2026-09-01T00:40:19,412 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml' 2026-09-01T00:40:19,413 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml' 2026-09-01T00:40:19,414 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml' 2026-09-01T00:40:19,415 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml' 2026-09-01T00:40:19,417 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml' 2026-09-01T00:40:19,418 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml' 2026-09-01T00:40:19,419 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml' 2026-09-01T00:40:19,421 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py' 2026-09-01T00:40:19,422 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml' 2026-09-01T00:40:19,424 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml' 2026-09-01T00:40:19,425 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml' 2026-09-01T00:40:19,426 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml' 2026-09-01T00:40:19,428 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml' 2026-09-01T00:40:19,429 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml' 2026-09-01T00:40:19,430 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml' 2026-09-01T00:40:19,431 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml' 2026-09-01T00:40:19,433 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml' 2026-09-01T00:40:19,434 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml' 2026-09-01T00:40:19,435 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml' 2026-09-01T00:40:19,436 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml' 2026-09-01T00:40:19,438 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml' 2026-09-01T00:40:19,439 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml' 2026-09-01T00:40:19,440 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml' 2026-09-01T00:40:19,441 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml' 2026-09-01T00:40:19,443 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml' 2026-09-01T00:40:19,444 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml' 2026-09-01T00:40:19,445 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml' 2026-09-01T00:40:19,447 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml' 2026-09-01T00:40:19,448 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml' 2026-09-01T00:40:19,449 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py' 2026-09-01T00:40:19,451 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml' 2026-09-01T00:40:19,452 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml' 2026-09-01T00:40:19,453 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml' 2026-09-01T00:40:19,454 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml' 2026-09-01T00:40:19,456 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml' 2026-09-01T00:40:19,457 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml' 2026-09-01T00:40:19,458 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml' 2026-09-01T00:40:19,459 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml' 2026-09-01T00:40:19,461 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml' 2026-09-01T00:40:19,462 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml' 2026-09-01T00:40:19,463 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml' 2026-09-01T00:40:19,464 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml' 2026-09-01T00:40:19,466 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml' 2026-09-01T00:40:19,467 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml' 2026-09-01T00:40:19,468 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml' 2026-09-01T00:40:19,469 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml' 2026-09-01T00:40:19,471 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml' 2026-09-01T00:40:19,472 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml' 2026-09-01T00:40:19,473 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml' 2026-09-01T00:40:19,475 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml' 2026-09-01T00:40:19,476 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml' 2026-09-01T00:40:19,477 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py' 2026-09-01T00:40:19,479 adding 'lm_eval/tasks/afrobench/naijarc/README.md' 2026-09-01T00:40:19,480 adding 'lm_eval/tasks/afrobench/naijarc/naijarc.yaml' 2026-09-01T00:40:19,482 adding 'lm_eval/tasks/afrobench/naijarc/utils.py' 2026-09-01T00:40:19,484 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc' 2026-09-01T00:40:19,485 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml' 2026-09-01T00:40:19,486 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml' 2026-09-01T00:40:19,487 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml' 2026-09-01T00:40:19,489 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc' 2026-09-01T00:40:19,490 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml' 2026-09-01T00:40:19,492 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml' 2026-09-01T00:40:19,493 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml' 2026-09-01T00:40:19,495 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc' 2026-09-01T00:40:19,496 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml' 2026-09-01T00:40:19,497 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml' 2026-09-01T00:40:19,498 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml' 2026-09-01T00:40:19,500 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc' 2026-09-01T00:40:19,501 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml' 2026-09-01T00:40:19,503 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml' 2026-09-01T00:40:19,504 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml' 2026-09-01T00:40:19,506 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc' 2026-09-01T00:40:19,507 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml' 2026-09-01T00:40:19,508 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml' 2026-09-01T00:40:19,509 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml' 2026-09-01T00:40:19,511 adding 'lm_eval/tasks/afrobench/nollysenti/README.md' 2026-09-01T00:40:19,512 adding 'lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml' 2026-09-01T00:40:19,514 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti' 2026-09-01T00:40:19,515 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml' 2026-09-01T00:40:19,516 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml' 2026-09-01T00:40:19,518 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml' 2026-09-01T00:40:19,519 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml' 2026-09-01T00:40:19,520 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml' 2026-09-01T00:40:19,521 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py' 2026-09-01T00:40:19,523 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti' 2026-09-01T00:40:19,524 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml' 2026-09-01T00:40:19,525 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml' 2026-09-01T00:40:19,526 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml' 2026-09-01T00:40:19,527 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml' 2026-09-01T00:40:19,529 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml' 2026-09-01T00:40:19,530 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py' 2026-09-01T00:40:19,532 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti' 2026-09-01T00:40:19,533 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml' 2026-09-01T00:40:19,534 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml' 2026-09-01T00:40:19,535 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml' 2026-09-01T00:40:19,536 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml' 2026-09-01T00:40:19,538 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml' 2026-09-01T00:40:19,539 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py' 2026-09-01T00:40:19,541 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti' 2026-09-01T00:40:19,542 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml' 2026-09-01T00:40:19,543 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml' 2026-09-01T00:40:19,544 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml' 2026-09-01T00:40:19,546 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml' 2026-09-01T00:40:19,547 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml' 2026-09-01T00:40:19,548 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py' 2026-09-01T00:40:19,550 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti' 2026-09-01T00:40:19,551 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml' 2026-09-01T00:40:19,552 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml' 2026-09-01T00:40:19,554 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml' 2026-09-01T00:40:19,555 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml' 2026-09-01T00:40:19,556 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml' 2026-09-01T00:40:19,557 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py' 2026-09-01T00:40:19,559 adding 'lm_eval/tasks/afrobench/ntrex/README.md' 2026-09-01T00:40:19,561 adding 'lm_eval/tasks/afrobench/ntrex/gen_utils.py' 2026-09-01T00:40:19,562 adding 'lm_eval/tasks/afrobench/ntrex/ntrex.yaml' 2026-09-01T00:40:19,565 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex' 2026-09-01T00:40:19,566 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,567 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,568 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,569 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,570 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,571 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,572 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,574 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,575 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,576 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,577 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,578 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,580 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,581 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,582 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,583 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,585 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,586 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,587 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,588 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,590 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,591 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-09-01T00:40:19,592 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-09-01T00:40:19,594 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,595 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,596 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,597 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,598 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,599 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,601 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,602 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,603 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,605 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex' 2026-09-01T00:40:19,607 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-09-01T00:40:19,608 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:40:19,609 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-09-01T00:40:19,610 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-09-01T00:40:19,612 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:40:19,613 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-09-01T00:40:19,615 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-09-01T00:40:19,616 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:40:19,617 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-09-01T00:40:19,618 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-09-01T00:40:19,619 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-09-01T00:40:19,621 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-09-01T00:40:19,622 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-09-01T00:40:19,623 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-09-01T00:40:19,624 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-09-01T00:40:19,625 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-09-01T00:40:19,626 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-09-01T00:40:19,627 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-09-01T00:40:19,629 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-09-01T00:40:19,630 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:40:19,631 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-09-01T00:40:19,632 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-09-01T00:40:19,633 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-09-01T00:40:19,635 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:40:19,636 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-09-01T00:40:19,637 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:40:19,638 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-09-01T00:40:19,639 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-09-01T00:40:19,641 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-09-01T00:40:19,642 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-09-01T00:40:19,643 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-09-01T00:40:19,644 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-09-01T00:40:19,647 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex' 2026-09-01T00:40:19,649 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,650 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,651 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,652 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,654 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,655 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,656 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,657 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,658 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,660 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,661 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,662 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,663 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,664 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,665 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,667 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,668 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,669 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,670 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,671 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,672 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,674 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-09-01T00:40:19,675 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-09-01T00:40:19,676 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,677 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,678 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,680 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,681 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,682 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,683 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,684 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,686 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,688 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex' 2026-09-01T00:40:19,689 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-09-01T00:40:19,690 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:40:19,692 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-09-01T00:40:19,694 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-09-01T00:40:19,695 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:40:19,696 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-09-01T00:40:19,697 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-09-01T00:40:19,699 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:40:19,700 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-09-01T00:40:19,701 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-09-01T00:40:19,702 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-09-01T00:40:19,704 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-09-01T00:40:19,705 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-09-01T00:40:19,706 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-09-01T00:40:19,707 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-09-01T00:40:19,708 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-09-01T00:40:19,709 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-09-01T00:40:19,711 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-09-01T00:40:19,712 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-09-01T00:40:19,713 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:40:19,714 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-09-01T00:40:19,715 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-09-01T00:40:19,716 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-09-01T00:40:19,718 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:40:19,719 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-09-01T00:40:19,720 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:40:19,721 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-09-01T00:40:19,722 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-09-01T00:40:19,723 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-09-01T00:40:19,725 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-09-01T00:40:19,726 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-09-01T00:40:19,727 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-09-01T00:40:19,730 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex' 2026-09-01T00:40:19,731 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,732 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,733 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,734 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,736 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,737 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,738 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,739 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,740 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,741 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,742 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,744 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,745 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,746 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,747 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,748 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,749 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,750 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,751 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,753 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,754 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,755 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-09-01T00:40:19,756 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-09-01T00:40:19,757 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:40:19,758 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,760 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,761 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-09-01T00:40:19,762 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,763 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,764 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,766 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,767 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-09-01T00:40:19,769 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex' 2026-09-01T00:40:19,770 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-09-01T00:40:19,771 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:40:19,773 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-09-01T00:40:19,774 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-09-01T00:40:19,775 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:40:19,776 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-09-01T00:40:19,778 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-09-01T00:40:19,779 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:40:19,780 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-09-01T00:40:19,781 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-09-01T00:40:19,782 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-09-01T00:40:19,783 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-09-01T00:40:19,784 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-09-01T00:40:19,785 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-09-01T00:40:19,786 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-09-01T00:40:19,788 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-09-01T00:40:19,789 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-09-01T00:40:19,790 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-09-01T00:40:19,791 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-09-01T00:40:19,792 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:40:19,793 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-09-01T00:40:19,795 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-09-01T00:40:19,796 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-09-01T00:40:19,797 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:40:19,798 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-09-01T00:40:19,799 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:40:19,800 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-09-01T00:40:19,802 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-09-01T00:40:19,803 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-09-01T00:40:19,804 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-09-01T00:40:19,805 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-09-01T00:40:19,806 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-09-01T00:40:19,808 adding 'lm_eval/tasks/afrobench/openai_mmlu/README.md' 2026-09-01T00:40:19,810 adding 'lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml' 2026-09-01T00:40:19,811 adding 'lm_eval/tasks/afrobench/openai_mmlu/utils.py' 2026-09-01T00:40:19,813 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu' 2026-09-01T00:40:19,814 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml' 2026-09-01T00:40:19,815 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml' 2026-09-01T00:40:19,816 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml' 2026-09-01T00:40:19,818 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu' 2026-09-01T00:40:19,819 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml' 2026-09-01T00:40:19,821 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml' 2026-09-01T00:40:19,822 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml' 2026-09-01T00:40:19,824 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu' 2026-09-01T00:40:19,825 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml' 2026-09-01T00:40:19,826 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml' 2026-09-01T00:40:19,827 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml' 2026-09-01T00:40:19,828 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu' 2026-09-01T00:40:19,830 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml' 2026-09-01T00:40:19,831 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml' 2026-09-01T00:40:19,832 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml' 2026-09-01T00:40:19,833 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu' 2026-09-01T00:40:19,834 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml' 2026-09-01T00:40:19,836 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml' 2026-09-01T00:40:19,837 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml' 2026-09-01T00:40:19,839 adding 'lm_eval/tasks/afrobench/salt/README.md' 2026-09-01T00:40:19,840 adding 'lm_eval/tasks/afrobench/salt/gen_utils.py' 2026-09-01T00:40:19,841 adding 'lm_eval/tasks/afrobench/salt/salt.yaml' 2026-09-01T00:40:19,843 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt' 2026-09-01T00:40:19,844 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml' 2026-09-01T00:40:19,845 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml' 2026-09-01T00:40:19,846 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml' 2026-09-01T00:40:19,847 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml' 2026-09-01T00:40:19,848 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml' 2026-09-01T00:40:19,850 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml' 2026-09-01T00:40:19,851 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml' 2026-09-01T00:40:19,852 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml' 2026-09-01T00:40:19,853 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml' 2026-09-01T00:40:19,854 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml' 2026-09-01T00:40:19,855 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml' 2026-09-01T00:40:19,856 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml' 2026-09-01T00:40:19,858 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml' 2026-09-01T00:40:19,859 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml' 2026-09-01T00:40:19,861 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt' 2026-09-01T00:40:19,862 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml' 2026-09-01T00:40:19,863 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml' 2026-09-01T00:40:19,864 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml' 2026-09-01T00:40:19,865 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml' 2026-09-01T00:40:19,867 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml' 2026-09-01T00:40:19,868 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml' 2026-09-01T00:40:19,869 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml' 2026-09-01T00:40:19,870 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml' 2026-09-01T00:40:19,871 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml' 2026-09-01T00:40:19,873 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml' 2026-09-01T00:40:19,874 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml' 2026-09-01T00:40:19,875 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml' 2026-09-01T00:40:19,876 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml' 2026-09-01T00:40:19,877 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml' 2026-09-01T00:40:19,879 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt' 2026-09-01T00:40:19,880 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml' 2026-09-01T00:40:19,881 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml' 2026-09-01T00:40:19,882 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml' 2026-09-01T00:40:19,883 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml' 2026-09-01T00:40:19,884 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml' 2026-09-01T00:40:19,886 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml' 2026-09-01T00:40:19,887 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml' 2026-09-01T00:40:19,888 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml' 2026-09-01T00:40:19,889 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml' 2026-09-01T00:40:19,890 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml' 2026-09-01T00:40:19,891 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml' 2026-09-01T00:40:19,892 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml' 2026-09-01T00:40:19,893 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml' 2026-09-01T00:40:19,895 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml' 2026-09-01T00:40:19,896 adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh' 2026-09-01T00:40:19,898 adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh' 2026-09-01T00:40:19,900 adding 'lm_eval/tasks/afrobench/sib/README.md' 2026-09-01T00:40:19,901 adding 'lm_eval/tasks/afrobench/sib/sib.yaml' 2026-09-01T00:40:19,902 adding 'lm_eval/tasks/afrobench/sib/utils.py' 2026-09-01T00:40:19,905 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib' 2026-09-01T00:40:19,906 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml' 2026-09-01T00:40:19,908 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml' 2026-09-01T00:40:19,909 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml' 2026-09-01T00:40:19,910 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml' 2026-09-01T00:40:19,911 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml' 2026-09-01T00:40:19,912 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml' 2026-09-01T00:40:19,914 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml' 2026-09-01T00:40:19,915 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml' 2026-09-01T00:40:19,916 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml' 2026-09-01T00:40:19,917 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml' 2026-09-01T00:40:19,918 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml' 2026-09-01T00:40:19,920 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml' 2026-09-01T00:40:19,921 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml' 2026-09-01T00:40:19,922 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml' 2026-09-01T00:40:19,923 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml' 2026-09-01T00:40:19,924 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml' 2026-09-01T00:40:19,926 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml' 2026-09-01T00:40:19,927 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml' 2026-09-01T00:40:19,928 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml' 2026-09-01T00:40:19,929 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml' 2026-09-01T00:40:19,930 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml' 2026-09-01T00:40:19,931 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml' 2026-09-01T00:40:19,933 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml' 2026-09-01T00:40:19,934 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml' 2026-09-01T00:40:19,935 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml' 2026-09-01T00:40:19,936 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml' 2026-09-01T00:40:19,938 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml' 2026-09-01T00:40:19,939 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml' 2026-09-01T00:40:19,940 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml' 2026-09-01T00:40:19,941 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml' 2026-09-01T00:40:19,942 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml' 2026-09-01T00:40:19,943 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml' 2026-09-01T00:40:19,944 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml' 2026-09-01T00:40:19,945 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml' 2026-09-01T00:40:19,946 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml' 2026-09-01T00:40:19,947 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml' 2026-09-01T00:40:19,948 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml' 2026-09-01T00:40:19,949 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml' 2026-09-01T00:40:19,951 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml' 2026-09-01T00:40:19,952 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml' 2026-09-01T00:40:19,953 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml' 2026-09-01T00:40:19,954 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml' 2026-09-01T00:40:19,955 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml' 2026-09-01T00:40:19,956 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml' 2026-09-01T00:40:19,957 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml' 2026-09-01T00:40:19,958 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml' 2026-09-01T00:40:19,960 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml' 2026-09-01T00:40:19,961 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml' 2026-09-01T00:40:19,962 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml' 2026-09-01T00:40:19,963 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml' 2026-09-01T00:40:19,964 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml' 2026-09-01T00:40:19,965 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml' 2026-09-01T00:40:19,967 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml' 2026-09-01T00:40:19,968 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml' 2026-09-01T00:40:19,969 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml' 2026-09-01T00:40:19,970 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml' 2026-09-01T00:40:19,971 adding 'lm_eval/tasks/afrobench/sib/prompt_1/utils.py' 2026-09-01T00:40:19,974 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib' 2026-09-01T00:40:19,975 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml' 2026-09-01T00:40:19,977 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml' 2026-09-01T00:40:19,978 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml' 2026-09-01T00:40:19,979 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml' 2026-09-01T00:40:19,980 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml' 2026-09-01T00:40:19,981 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml' 2026-09-01T00:40:19,982 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml' 2026-09-01T00:40:19,984 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml' 2026-09-01T00:40:19,985 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml' 2026-09-01T00:40:19,986 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml' 2026-09-01T00:40:19,988 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml' 2026-09-01T00:40:19,989 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml' 2026-09-01T00:40:19,990 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml' 2026-09-01T00:40:19,991 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml' 2026-09-01T00:40:19,992 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml' 2026-09-01T00:40:19,993 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml' 2026-09-01T00:40:19,995 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml' 2026-09-01T00:40:19,996 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml' 2026-09-01T00:40:19,997 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml' 2026-09-01T00:40:19,998 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml' 2026-09-01T00:40:19,999 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml' 2026-09-01T00:40:20,000 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml' 2026-09-01T00:40:20,002 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml' 2026-09-01T00:40:20,003 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml' 2026-09-01T00:40:20,004 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml' 2026-09-01T00:40:20,005 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml' 2026-09-01T00:40:20,006 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml' 2026-09-01T00:40:20,007 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml' 2026-09-01T00:40:20,008 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml' 2026-09-01T00:40:20,010 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml' 2026-09-01T00:40:20,011 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml' 2026-09-01T00:40:20,012 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml' 2026-09-01T00:40:20,013 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml' 2026-09-01T00:40:20,014 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml' 2026-09-01T00:40:20,015 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml' 2026-09-01T00:40:20,017 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml' 2026-09-01T00:40:20,018 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml' 2026-09-01T00:40:20,019 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml' 2026-09-01T00:40:20,020 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml' 2026-09-01T00:40:20,021 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml' 2026-09-01T00:40:20,022 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml' 2026-09-01T00:40:20,024 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml' 2026-09-01T00:40:20,025 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml' 2026-09-01T00:40:20,026 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml' 2026-09-01T00:40:20,027 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml' 2026-09-01T00:40:20,028 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml' 2026-09-01T00:40:20,030 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml' 2026-09-01T00:40:20,031 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml' 2026-09-01T00:40:20,032 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml' 2026-09-01T00:40:20,033 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml' 2026-09-01T00:40:20,034 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml' 2026-09-01T00:40:20,035 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml' 2026-09-01T00:40:20,037 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml' 2026-09-01T00:40:20,038 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml' 2026-09-01T00:40:20,039 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml' 2026-09-01T00:40:20,040 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml' 2026-09-01T00:40:20,041 adding 'lm_eval/tasks/afrobench/sib/prompt_2/utils.py' 2026-09-01T00:40:20,044 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib' 2026-09-01T00:40:20,045 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml' 2026-09-01T00:40:20,047 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml' 2026-09-01T00:40:20,048 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml' 2026-09-01T00:40:20,049 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml' 2026-09-01T00:40:20,050 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml' 2026-09-01T00:40:20,051 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml' 2026-09-01T00:40:20,052 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml' 2026-09-01T00:40:20,054 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml' 2026-09-01T00:40:20,055 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml' 2026-09-01T00:40:20,056 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml' 2026-09-01T00:40:20,057 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml' 2026-09-01T00:40:20,058 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml' 2026-09-01T00:40:20,059 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml' 2026-09-01T00:40:20,060 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml' 2026-09-01T00:40:20,061 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml' 2026-09-01T00:40:20,062 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml' 2026-09-01T00:40:20,064 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml' 2026-09-01T00:40:20,065 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml' 2026-09-01T00:40:20,066 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml' 2026-09-01T00:40:20,067 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml' 2026-09-01T00:40:20,068 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml' 2026-09-01T00:40:20,069 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml' 2026-09-01T00:40:20,071 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml' 2026-09-01T00:40:20,072 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml' 2026-09-01T00:40:20,073 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml' 2026-09-01T00:40:20,074 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml' 2026-09-01T00:40:20,075 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml' 2026-09-01T00:40:20,076 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml' 2026-09-01T00:40:20,077 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml' 2026-09-01T00:40:20,079 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml' 2026-09-01T00:40:20,080 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml' 2026-09-01T00:40:20,081 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml' 2026-09-01T00:40:20,082 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml' 2026-09-01T00:40:20,083 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml' 2026-09-01T00:40:20,084 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml' 2026-09-01T00:40:20,086 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml' 2026-09-01T00:40:20,087 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml' 2026-09-01T00:40:20,088 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml' 2026-09-01T00:40:20,089 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml' 2026-09-01T00:40:20,090 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml' 2026-09-01T00:40:20,091 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml' 2026-09-01T00:40:20,093 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml' 2026-09-01T00:40:20,094 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml' 2026-09-01T00:40:20,095 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml' 2026-09-01T00:40:20,096 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml' 2026-09-01T00:40:20,097 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml' 2026-09-01T00:40:20,099 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml' 2026-09-01T00:40:20,100 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml' 2026-09-01T00:40:20,101 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml' 2026-09-01T00:40:20,102 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml' 2026-09-01T00:40:20,103 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml' 2026-09-01T00:40:20,104 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml' 2026-09-01T00:40:20,106 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml' 2026-09-01T00:40:20,107 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml' 2026-09-01T00:40:20,108 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml' 2026-09-01T00:40:20,109 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml' 2026-09-01T00:40:20,110 adding 'lm_eval/tasks/afrobench/sib/prompt_3/utils.py' 2026-09-01T00:40:20,113 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib' 2026-09-01T00:40:20,114 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml' 2026-09-01T00:40:20,115 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml' 2026-09-01T00:40:20,116 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml' 2026-09-01T00:40:20,117 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml' 2026-09-01T00:40:20,118 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml' 2026-09-01T00:40:20,119 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml' 2026-09-01T00:40:20,120 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml' 2026-09-01T00:40:20,121 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml' 2026-09-01T00:40:20,122 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml' 2026-09-01T00:40:20,124 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml' 2026-09-01T00:40:20,125 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml' 2026-09-01T00:40:20,126 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml' 2026-09-01T00:40:20,127 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml' 2026-09-01T00:40:20,128 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml' 2026-09-01T00:40:20,130 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml' 2026-09-01T00:40:20,131 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml' 2026-09-01T00:40:20,132 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml' 2026-09-01T00:40:20,133 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml' 2026-09-01T00:40:20,134 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml' 2026-09-01T00:40:20,136 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml' 2026-09-01T00:40:20,137 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml' 2026-09-01T00:40:20,138 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml' 2026-09-01T00:40:20,139 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml' 2026-09-01T00:40:20,140 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml' 2026-09-01T00:40:20,141 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml' 2026-09-01T00:40:20,142 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml' 2026-09-01T00:40:20,144 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml' 2026-09-01T00:40:20,145 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml' 2026-09-01T00:40:20,146 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml' 2026-09-01T00:40:20,147 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml' 2026-09-01T00:40:20,148 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml' 2026-09-01T00:40:20,149 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml' 2026-09-01T00:40:20,151 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml' 2026-09-01T00:40:20,152 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml' 2026-09-01T00:40:20,153 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml' 2026-09-01T00:40:20,154 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml' 2026-09-01T00:40:20,155 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml' 2026-09-01T00:40:20,157 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml' 2026-09-01T00:40:20,158 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml' 2026-09-01T00:40:20,159 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml' 2026-09-01T00:40:20,160 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml' 2026-09-01T00:40:20,161 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml' 2026-09-01T00:40:20,162 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml' 2026-09-01T00:40:20,164 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml' 2026-09-01T00:40:20,165 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml' 2026-09-01T00:40:20,166 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml' 2026-09-01T00:40:20,167 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml' 2026-09-01T00:40:20,168 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml' 2026-09-01T00:40:20,169 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml' 2026-09-01T00:40:20,170 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml' 2026-09-01T00:40:20,172 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml' 2026-09-01T00:40:20,173 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml' 2026-09-01T00:40:20,174 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml' 2026-09-01T00:40:20,175 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml' 2026-09-01T00:40:20,176 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml' 2026-09-01T00:40:20,177 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml' 2026-09-01T00:40:20,178 adding 'lm_eval/tasks/afrobench/sib/prompt_4/utils.py' 2026-09-01T00:40:20,181 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib' 2026-09-01T00:40:20,182 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml' 2026-09-01T00:40:20,183 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml' 2026-09-01T00:40:20,185 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml' 2026-09-01T00:40:20,186 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml' 2026-09-01T00:40:20,187 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml' 2026-09-01T00:40:20,188 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml' 2026-09-01T00:40:20,189 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml' 2026-09-01T00:40:20,191 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml' 2026-09-01T00:40:20,192 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml' 2026-09-01T00:40:20,193 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml' 2026-09-01T00:40:20,194 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml' 2026-09-01T00:40:20,196 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml' 2026-09-01T00:40:20,197 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml' 2026-09-01T00:40:20,198 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml' 2026-09-01T00:40:20,199 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml' 2026-09-01T00:40:20,200 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml' 2026-09-01T00:40:20,202 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml' 2026-09-01T00:40:20,203 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml' 2026-09-01T00:40:20,204 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml' 2026-09-01T00:40:20,205 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml' 2026-09-01T00:40:20,207 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml' 2026-09-01T00:40:20,208 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml' 2026-09-01T00:40:20,209 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml' 2026-09-01T00:40:20,210 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml' 2026-09-01T00:40:20,212 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml' 2026-09-01T00:40:20,213 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml' 2026-09-01T00:40:20,214 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml' 2026-09-01T00:40:20,216 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml' 2026-09-01T00:40:20,217 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml' 2026-09-01T00:40:20,218 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml' 2026-09-01T00:40:20,219 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml' 2026-09-01T00:40:20,221 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml' 2026-09-01T00:40:20,222 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml' 2026-09-01T00:40:20,223 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml' 2026-09-01T00:40:20,225 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml' 2026-09-01T00:40:20,226 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml' 2026-09-01T00:40:20,227 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml' 2026-09-01T00:40:20,229 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml' 2026-09-01T00:40:20,230 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml' 2026-09-01T00:40:20,231 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml' 2026-09-01T00:40:20,232 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml' 2026-09-01T00:40:20,233 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml' 2026-09-01T00:40:20,234 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml' 2026-09-01T00:40:20,235 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml' 2026-09-01T00:40:20,237 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml' 2026-09-01T00:40:20,238 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml' 2026-09-01T00:40:20,239 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml' 2026-09-01T00:40:20,240 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml' 2026-09-01T00:40:20,242 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml' 2026-09-01T00:40:20,243 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml' 2026-09-01T00:40:20,244 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml' 2026-09-01T00:40:20,245 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml' 2026-09-01T00:40:20,247 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml' 2026-09-01T00:40:20,248 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml' 2026-09-01T00:40:20,249 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml' 2026-09-01T00:40:20,250 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml' 2026-09-01T00:40:20,251 adding 'lm_eval/tasks/afrobench/sib/prompt_5/utils.py' 2026-09-01T00:40:20,253 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/README.md' 2026-09-01T00:40:20,254 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml' 2026-09-01T00:40:20,256 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/utils.py' 2026-09-01T00:40:20,258 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy' 2026-09-01T00:40:20,259 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml' 2026-09-01T00:40:20,260 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml' 2026-09-01T00:40:20,261 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml' 2026-09-01T00:40:20,262 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml' 2026-09-01T00:40:20,264 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml' 2026-09-01T00:40:20,265 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml' 2026-09-01T00:40:20,266 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml' 2026-09-01T00:40:20,267 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py' 2026-09-01T00:40:20,269 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy' 2026-09-01T00:40:20,270 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml' 2026-09-01T00:40:20,271 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml' 2026-09-01T00:40:20,273 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml' 2026-09-01T00:40:20,274 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml' 2026-09-01T00:40:20,275 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml' 2026-09-01T00:40:20,276 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml' 2026-09-01T00:40:20,278 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml' 2026-09-01T00:40:20,279 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py' 2026-09-01T00:40:20,281 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy' 2026-09-01T00:40:20,282 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml' 2026-09-01T00:40:20,283 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml' 2026-09-01T00:40:20,284 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml' 2026-09-01T00:40:20,285 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml' 2026-09-01T00:40:20,286 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml' 2026-09-01T00:40:20,287 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml' 2026-09-01T00:40:20,289 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml' 2026-09-01T00:40:20,290 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py' 2026-09-01T00:40:20,291 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy' 2026-09-01T00:40:20,292 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml' 2026-09-01T00:40:20,294 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml' 2026-09-01T00:40:20,295 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml' 2026-09-01T00:40:20,296 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml' 2026-09-01T00:40:20,297 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml' 2026-09-01T00:40:20,298 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml' 2026-09-01T00:40:20,299 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml' 2026-09-01T00:40:20,300 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py' 2026-09-01T00:40:20,302 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy' 2026-09-01T00:40:20,303 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml' 2026-09-01T00:40:20,304 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml' 2026-09-01T00:40:20,306 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml' 2026-09-01T00:40:20,307 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml' 2026-09-01T00:40:20,308 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml' 2026-09-01T00:40:20,309 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml' 2026-09-01T00:40:20,310 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml' 2026-09-01T00:40:20,311 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py' 2026-09-01T00:40:20,314 adding 'lm_eval/tasks/afrobench/xlsum/README.md' 2026-09-01T00:40:20,315 adding 'lm_eval/tasks/afrobench/xlsum/utils.py' 2026-09-01T00:40:20,316 adding 'lm_eval/tasks/afrobench/xlsum/xlsum.yaml' 2026-09-01T00:40:20,318 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py' 2026-09-01T00:40:20,319 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum' 2026-09-01T00:40:20,321 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml' 2026-09-01T00:40:20,322 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml' 2026-09-01T00:40:20,323 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml' 2026-09-01T00:40:20,324 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml' 2026-09-01T00:40:20,325 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml' 2026-09-01T00:40:20,327 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml' 2026-09-01T00:40:20,328 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml' 2026-09-01T00:40:20,329 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml' 2026-09-01T00:40:20,330 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml' 2026-09-01T00:40:20,331 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml' 2026-09-01T00:40:20,333 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml' 2026-09-01T00:40:20,334 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml' 2026-09-01T00:40:20,336 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py' 2026-09-01T00:40:20,337 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum' 2026-09-01T00:40:20,338 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml' 2026-09-01T00:40:20,339 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml' 2026-09-01T00:40:20,340 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml' 2026-09-01T00:40:20,341 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml' 2026-09-01T00:40:20,342 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml' 2026-09-01T00:40:20,343 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml' 2026-09-01T00:40:20,344 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml' 2026-09-01T00:40:20,345 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml' 2026-09-01T00:40:20,347 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml' 2026-09-01T00:40:20,348 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml' 2026-09-01T00:40:20,349 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml' 2026-09-01T00:40:20,350 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml' 2026-09-01T00:40:20,352 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py' 2026-09-01T00:40:20,353 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum' 2026-09-01T00:40:20,354 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml' 2026-09-01T00:40:20,355 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml' 2026-09-01T00:40:20,356 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml' 2026-09-01T00:40:20,358 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml' 2026-09-01T00:40:20,359 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml' 2026-09-01T00:40:20,360 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml' 2026-09-01T00:40:20,361 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml' 2026-09-01T00:40:20,362 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml' 2026-09-01T00:40:20,364 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml' 2026-09-01T00:40:20,365 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml' 2026-09-01T00:40:20,366 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml' 2026-09-01T00:40:20,367 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml' 2026-09-01T00:40:20,370 adding 'lm_eval/tasks/agieval/README.md' 2026-09-01T00:40:20,371 adding 'lm_eval/tasks/agieval/agieval.yaml' 2026-09-01T00:40:20,372 adding 'lm_eval/tasks/agieval/agieval_cn.yaml' 2026-09-01T00:40:20,373 adding 'lm_eval/tasks/agieval/agieval_en.yaml' 2026-09-01T00:40:20,375 adding 'lm_eval/tasks/agieval/agieval_nous.yaml' 2026-09-01T00:40:20,376 adding 'lm_eval/tasks/agieval/aqua-rat.yaml' 2026-09-01T00:40:20,377 adding 'lm_eval/tasks/agieval/gaokao-biology.yaml' 2026-09-01T00:40:20,378 adding 'lm_eval/tasks/agieval/gaokao-chemistry.yaml' 2026-09-01T00:40:20,379 adding 'lm_eval/tasks/agieval/gaokao-chinese.yaml' 2026-09-01T00:40:20,380 adding 'lm_eval/tasks/agieval/gaokao-english.yaml' 2026-09-01T00:40:20,382 adding 'lm_eval/tasks/agieval/gaokao-geography.yaml' 2026-09-01T00:40:20,383 adding 'lm_eval/tasks/agieval/gaokao-history.yaml' 2026-09-01T00:40:20,384 adding 'lm_eval/tasks/agieval/gaokao-mathcloze.yaml' 2026-09-01T00:40:20,385 adding 'lm_eval/tasks/agieval/gaokao-mathqa.yaml' 2026-09-01T00:40:20,386 adding 'lm_eval/tasks/agieval/gaokao-physics.yaml' 2026-09-01T00:40:20,387 adding 'lm_eval/tasks/agieval/jec-qa-ca.yaml' 2026-09-01T00:40:20,389 adding 'lm_eval/tasks/agieval/jec-qa-kd.yaml' 2026-09-01T00:40:20,390 adding 'lm_eval/tasks/agieval/logiqa-en.yaml' 2026-09-01T00:40:20,391 adding 'lm_eval/tasks/agieval/logiqa-zh.yaml' 2026-09-01T00:40:20,392 adding 'lm_eval/tasks/agieval/lsat-ar.yaml' 2026-09-01T00:40:20,393 adding 'lm_eval/tasks/agieval/lsat-lr.yaml' 2026-09-01T00:40:20,394 adding 'lm_eval/tasks/agieval/lsat-rc.yaml' 2026-09-01T00:40:20,395 adding 'lm_eval/tasks/agieval/math.yaml' 2026-09-01T00:40:20,396 adding 'lm_eval/tasks/agieval/sat-en-without-passage.yaml' 2026-09-01T00:40:20,397 adding 'lm_eval/tasks/agieval/sat-en.yaml' 2026-09-01T00:40:20,398 adding 'lm_eval/tasks/agieval/sat-math.yaml' 2026-09-01T00:40:20,400 adding 'lm_eval/tasks/agieval/utils.py' 2026-09-01T00:40:20,402 adding 'lm_eval/tasks/aime/README.md' 2026-09-01T00:40:20,403 adding 'lm_eval/tasks/aime/aime.yaml' 2026-09-01T00:40:20,404 adding 'lm_eval/tasks/aime/aime24.yaml' 2026-09-01T00:40:20,405 adding 'lm_eval/tasks/aime/aime25.yaml' 2026-09-01T00:40:20,407 adding 'lm_eval/tasks/aime/utils.py' 2026-09-01T00:40:20,409 adding 'lm_eval/tasks/alghafa/copa_ar/README.md' 2026-09-01T00:40:20,410 adding 'lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml' 2026-09-01T00:40:20,412 adding 'lm_eval/tasks/alghafa/piqa_ar/README.md' 2026-09-01T00:40:20,413 adding 'lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml' 2026-09-01T00:40:20,415 adding 'lm_eval/tasks/anli/README.md' 2026-09-01T00:40:20,416 adding 'lm_eval/tasks/anli/anli_r1.yaml' 2026-09-01T00:40:20,417 adding 'lm_eval/tasks/anli/anli_r2.yaml' 2026-09-01T00:40:20,418 adding 'lm_eval/tasks/anli/anli_r3.yaml' 2026-09-01T00:40:20,421 adding 'lm_eval/tasks/arab_culture/README.md' 2026-09-01T00:40:20,422 adding 'lm_eval/tasks/arab_culture/_arab_culture.yaml' 2026-09-01T00:40:20,423 adding 'lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml' 2026-09-01T00:40:20,424 adding 'lm_eval/tasks/arab_culture/_arab_culture_levant.yaml' 2026-09-01T00:40:20,425 adding 'lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml' 2026-09-01T00:40:20,426 adding 'lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml' 2026-09-01T00:40:20,428 adding 'lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml' 2026-09-01T00:40:20,429 adding 'lm_eval/tasks/arab_culture/_generate_configs.py' 2026-09-01T00:40:20,430 adding 'lm_eval/tasks/arab_culture/arab_culture_algeria.yaml' 2026-09-01T00:40:20,431 adding 'lm_eval/tasks/arab_culture/arab_culture_egypt.yaml' 2026-09-01T00:40:20,432 adding 'lm_eval/tasks/arab_culture/arab_culture_jordan.yaml' 2026-09-01T00:40:20,434 adding 'lm_eval/tasks/arab_culture/arab_culture_ksa.yaml' 2026-09-01T00:40:20,435 adding 'lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml' 2026-09-01T00:40:20,436 adding 'lm_eval/tasks/arab_culture/arab_culture_libya.yaml' 2026-09-01T00:40:20,437 adding 'lm_eval/tasks/arab_culture/arab_culture_morocco.yaml' 2026-09-01T00:40:20,438 adding 'lm_eval/tasks/arab_culture/arab_culture_palestine.yaml' 2026-09-01T00:40:20,439 adding 'lm_eval/tasks/arab_culture/arab_culture_sudan.yaml' 2026-09-01T00:40:20,440 adding 'lm_eval/tasks/arab_culture/arab_culture_syria.yaml' 2026-09-01T00:40:20,442 adding 'lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml' 2026-09-01T00:40:20,443 adding 'lm_eval/tasks/arab_culture/arab_culture_uae.yaml' 2026-09-01T00:40:20,444 adding 'lm_eval/tasks/arab_culture/arab_culture_yemen.yaml' 2026-09-01T00:40:20,446 adding 'lm_eval/tasks/arab_culture/prompts.py' 2026-09-01T00:40:20,447 adding 'lm_eval/tasks/arab_culture/utils_mcq.py' 2026-09-01T00:40:20,450 adding 'lm_eval/tasks/arab_culture_completion/README.md' 2026-09-01T00:40:20,451 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml' 2026-09-01T00:40:20,452 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml' 2026-09-01T00:40:20,453 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml' 2026-09-01T00:40:20,454 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml' 2026-09-01T00:40:20,456 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml' 2026-09-01T00:40:20,457 adding 'lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml' 2026-09-01T00:40:20,458 adding 'lm_eval/tasks/arab_culture_completion/_generate_configs.py' 2026-09-01T00:40:20,459 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml' 2026-09-01T00:40:20,460 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml' 2026-09-01T00:40:20,461 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml' 2026-09-01T00:40:20,462 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml' 2026-09-01T00:40:20,464 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml' 2026-09-01T00:40:20,465 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml' 2026-09-01T00:40:20,466 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml' 2026-09-01T00:40:20,467 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml' 2026-09-01T00:40:20,468 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml' 2026-09-01T00:40:20,470 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml' 2026-09-01T00:40:20,471 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml' 2026-09-01T00:40:20,472 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml' 2026-09-01T00:40:20,473 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml' 2026-09-01T00:40:20,475 adding 'lm_eval/tasks/arab_culture_completion/prompts.py' 2026-09-01T00:40:20,476 adding 'lm_eval/tasks/arab_culture_completion/utils_completion.py' 2026-09-01T00:40:20,479 adding 'lm_eval/tasks/arabic_leaderboard_complete/README.md' 2026-09-01T00:40:20,480 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml' 2026-09-01T00:40:20,482 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml' 2026-09-01T00:40:20,484 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml' 2026-09-01T00:40:20,485 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml' 2026-09-01T00:40:20,486 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml' 2026-09-01T00:40:20,487 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml' 2026-09-01T00:40:20,488 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml' 2026-09-01T00:40:20,490 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml' 2026-09-01T00:40:20,491 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml' 2026-09-01T00:40:20,492 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml' 2026-09-01T00:40:20,493 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml' 2026-09-01T00:40:20,494 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py' 2026-09-01T00:40:20,496 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml' 2026-09-01T00:40:20,497 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml' 2026-09-01T00:40:20,499 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py' 2026-09-01T00:40:20,502 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml' 2026-09-01T00:40:20,503 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml' 2026-09-01T00:40:20,504 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml' 2026-09-01T00:40:20,505 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml' 2026-09-01T00:40:20,507 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml' 2026-09-01T00:40:20,508 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:20,509 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml' 2026-09-01T00:40:20,510 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml' 2026-09-01T00:40:20,511 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml' 2026-09-01T00:40:20,512 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml' 2026-09-01T00:40:20,514 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml' 2026-09-01T00:40:20,515 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml' 2026-09-01T00:40:20,516 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml' 2026-09-01T00:40:20,517 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml' 2026-09-01T00:40:20,518 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml' 2026-09-01T00:40:20,519 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml' 2026-09-01T00:40:20,521 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:20,522 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml' 2026-09-01T00:40:20,523 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml' 2026-09-01T00:40:20,524 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml' 2026-09-01T00:40:20,526 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:20,527 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:20,528 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml' 2026-09-01T00:40:20,529 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml' 2026-09-01T00:40:20,530 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:20,532 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:20,533 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:20,534 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:20,535 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml' 2026-09-01T00:40:20,536 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml' 2026-09-01T00:40:20,538 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml' 2026-09-01T00:40:20,539 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml' 2026-09-01T00:40:20,540 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml' 2026-09-01T00:40:20,541 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml' 2026-09-01T00:40:20,542 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml' 2026-09-01T00:40:20,543 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml' 2026-09-01T00:40:20,545 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml' 2026-09-01T00:40:20,546 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml' 2026-09-01T00:40:20,547 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml' 2026-09-01T00:40:20,548 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml' 2026-09-01T00:40:20,549 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml' 2026-09-01T00:40:20,551 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml' 2026-09-01T00:40:20,552 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml' 2026-09-01T00:40:20,553 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml' 2026-09-01T00:40:20,554 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml' 2026-09-01T00:40:20,555 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml' 2026-09-01T00:40:20,557 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml' 2026-09-01T00:40:20,558 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml' 2026-09-01T00:40:20,559 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml' 2026-09-01T00:40:20,560 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml' 2026-09-01T00:40:20,562 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml' 2026-09-01T00:40:20,563 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml' 2026-09-01T00:40:20,564 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml' 2026-09-01T00:40:20,565 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml' 2026-09-01T00:40:20,566 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml' 2026-09-01T00:40:20,567 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:20,569 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml' 2026-09-01T00:40:20,570 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml' 2026-09-01T00:40:20,571 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py' 2026-09-01T00:40:20,573 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml' 2026-09-01T00:40:20,574 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml' 2026-09-01T00:40:20,575 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py' 2026-09-01T00:40:20,577 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml' 2026-09-01T00:40:20,578 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml' 2026-09-01T00:40:20,579 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py' 2026-09-01T00:40:20,581 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml' 2026-09-01T00:40:20,582 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml' 2026-09-01T00:40:20,584 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py' 2026-09-01T00:40:20,585 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml' 2026-09-01T00:40:20,587 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml' 2026-09-01T00:40:20,588 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py' 2026-09-01T00:40:20,592 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml' 2026-09-01T00:40:20,593 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml' 2026-09-01T00:40:20,594 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py' 2026-09-01T00:40:20,596 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml' 2026-09-01T00:40:20,597 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml' 2026-09-01T00:40:20,599 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py' 2026-09-01T00:40:20,600 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml' 2026-09-01T00:40:20,601 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml' 2026-09-01T00:40:20,603 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py' 2026-09-01T00:40:20,604 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml' 2026-09-01T00:40:20,606 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml' 2026-09-01T00:40:20,607 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py' 2026-09-01T00:40:20,608 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml' 2026-09-01T00:40:20,610 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml' 2026-09-01T00:40:20,611 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py' 2026-09-01T00:40:20,613 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml' 2026-09-01T00:40:20,614 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml' 2026-09-01T00:40:20,616 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py' 2026-09-01T00:40:20,617 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml' 2026-09-01T00:40:20,619 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml' 2026-09-01T00:40:20,620 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py' 2026-09-01T00:40:20,623 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml' 2026-09-01T00:40:20,624 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml' 2026-09-01T00:40:20,625 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml' 2026-09-01T00:40:20,627 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml' 2026-09-01T00:40:20,628 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml' 2026-09-01T00:40:20,629 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml' 2026-09-01T00:40:20,630 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml' 2026-09-01T00:40:20,631 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml' 2026-09-01T00:40:20,633 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml' 2026-09-01T00:40:20,634 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml' 2026-09-01T00:40:20,635 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml' 2026-09-01T00:40:20,636 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml' 2026-09-01T00:40:20,638 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml' 2026-09-01T00:40:20,639 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml' 2026-09-01T00:40:20,640 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml' 2026-09-01T00:40:20,641 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml' 2026-09-01T00:40:20,642 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml' 2026-09-01T00:40:20,644 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml' 2026-09-01T00:40:20,645 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml' 2026-09-01T00:40:20,646 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml' 2026-09-01T00:40:20,647 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml' 2026-09-01T00:40:20,648 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml' 2026-09-01T00:40:20,649 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml' 2026-09-01T00:40:20,651 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml' 2026-09-01T00:40:20,652 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml' 2026-09-01T00:40:20,653 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml' 2026-09-01T00:40:20,654 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml' 2026-09-01T00:40:20,655 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml' 2026-09-01T00:40:20,657 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml' 2026-09-01T00:40:20,658 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml' 2026-09-01T00:40:20,659 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml' 2026-09-01T00:40:20,660 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml' 2026-09-01T00:40:20,661 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml' 2026-09-01T00:40:20,663 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml' 2026-09-01T00:40:20,664 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml' 2026-09-01T00:40:20,665 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml' 2026-09-01T00:40:20,666 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml' 2026-09-01T00:40:20,668 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml' 2026-09-01T00:40:20,669 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml' 2026-09-01T00:40:20,670 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml' 2026-09-01T00:40:20,671 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml' 2026-09-01T00:40:20,672 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml' 2026-09-01T00:40:20,674 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml' 2026-09-01T00:40:20,675 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml' 2026-09-01T00:40:20,676 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml' 2026-09-01T00:40:20,677 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml' 2026-09-01T00:40:20,678 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml' 2026-09-01T00:40:20,680 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml' 2026-09-01T00:40:20,681 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml' 2026-09-01T00:40:20,682 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml' 2026-09-01T00:40:20,684 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml' 2026-09-01T00:40:20,685 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml' 2026-09-01T00:40:20,686 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml' 2026-09-01T00:40:20,687 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml' 2026-09-01T00:40:20,688 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml' 2026-09-01T00:40:20,689 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml' 2026-09-01T00:40:20,691 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml' 2026-09-01T00:40:20,692 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml' 2026-09-01T00:40:20,693 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml' 2026-09-01T00:40:20,694 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py' 2026-09-01T00:40:20,696 adding 'lm_eval/tasks/arabic_leaderboard_light/README.md' 2026-09-01T00:40:20,698 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml' 2026-09-01T00:40:20,699 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml' 2026-09-01T00:40:20,701 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml' 2026-09-01T00:40:20,702 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml' 2026-09-01T00:40:20,703 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml' 2026-09-01T00:40:20,704 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml' 2026-09-01T00:40:20,706 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml' 2026-09-01T00:40:20,707 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml' 2026-09-01T00:40:20,708 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml' 2026-09-01T00:40:20,709 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml' 2026-09-01T00:40:20,710 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml' 2026-09-01T00:40:20,712 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py' 2026-09-01T00:40:20,713 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml' 2026-09-01T00:40:20,714 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml' 2026-09-01T00:40:20,716 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py' 2026-09-01T00:40:20,718 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml' 2026-09-01T00:40:20,720 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml' 2026-09-01T00:40:20,721 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml' 2026-09-01T00:40:20,722 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml' 2026-09-01T00:40:20,723 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml' 2026-09-01T00:40:20,725 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml' 2026-09-01T00:40:20,726 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml' 2026-09-01T00:40:20,727 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml' 2026-09-01T00:40:20,728 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml' 2026-09-01T00:40:20,729 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml' 2026-09-01T00:40:20,730 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml' 2026-09-01T00:40:20,732 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml' 2026-09-01T00:40:20,733 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml' 2026-09-01T00:40:20,734 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml' 2026-09-01T00:40:20,735 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml' 2026-09-01T00:40:20,736 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml' 2026-09-01T00:40:20,738 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml' 2026-09-01T00:40:20,739 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml' 2026-09-01T00:40:20,740 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml' 2026-09-01T00:40:20,741 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml' 2026-09-01T00:40:20,742 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml' 2026-09-01T00:40:20,743 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml' 2026-09-01T00:40:20,745 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml' 2026-09-01T00:40:20,746 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml' 2026-09-01T00:40:20,747 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml' 2026-09-01T00:40:20,748 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml' 2026-09-01T00:40:20,749 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml' 2026-09-01T00:40:20,750 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml' 2026-09-01T00:40:20,751 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml' 2026-09-01T00:40:20,753 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml' 2026-09-01T00:40:20,754 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml' 2026-09-01T00:40:20,755 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml' 2026-09-01T00:40:20,756 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml' 2026-09-01T00:40:20,757 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml' 2026-09-01T00:40:20,758 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml' 2026-09-01T00:40:20,760 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml' 2026-09-01T00:40:20,761 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml' 2026-09-01T00:40:20,762 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml' 2026-09-01T00:40:20,763 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml' 2026-09-01T00:40:20,764 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml' 2026-09-01T00:40:20,765 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml' 2026-09-01T00:40:20,767 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml' 2026-09-01T00:40:20,768 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml' 2026-09-01T00:40:20,769 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml' 2026-09-01T00:40:20,770 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml' 2026-09-01T00:40:20,771 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml' 2026-09-01T00:40:20,773 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml' 2026-09-01T00:40:20,774 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml' 2026-09-01T00:40:20,775 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml' 2026-09-01T00:40:20,776 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml' 2026-09-01T00:40:20,777 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml' 2026-09-01T00:40:20,778 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml' 2026-09-01T00:40:20,780 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml' 2026-09-01T00:40:20,781 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml' 2026-09-01T00:40:20,782 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml' 2026-09-01T00:40:20,783 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml' 2026-09-01T00:40:20,784 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml' 2026-09-01T00:40:20,786 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml' 2026-09-01T00:40:20,787 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py' 2026-09-01T00:40:20,789 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml' 2026-09-01T00:40:20,790 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml' 2026-09-01T00:40:20,791 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py' 2026-09-01T00:40:20,793 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml' 2026-09-01T00:40:20,794 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml' 2026-09-01T00:40:20,795 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py' 2026-09-01T00:40:20,797 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml' 2026-09-01T00:40:20,798 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml' 2026-09-01T00:40:20,799 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py' 2026-09-01T00:40:20,801 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml' 2026-09-01T00:40:20,802 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml' 2026-09-01T00:40:20,804 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py' 2026-09-01T00:40:20,805 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml' 2026-09-01T00:40:20,807 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml' 2026-09-01T00:40:20,808 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py' 2026-09-01T00:40:20,809 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml' 2026-09-01T00:40:20,811 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml' 2026-09-01T00:40:20,812 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py' 2026-09-01T00:40:20,814 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml' 2026-09-01T00:40:20,815 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml' 2026-09-01T00:40:20,816 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py' 2026-09-01T00:40:20,818 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml' 2026-09-01T00:40:20,819 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml' 2026-09-01T00:40:20,820 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py' 2026-09-01T00:40:20,822 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml' 2026-09-01T00:40:20,823 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml' 2026-09-01T00:40:20,824 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py' 2026-09-01T00:40:20,826 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml' 2026-09-01T00:40:20,827 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml' 2026-09-01T00:40:20,829 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py' 2026-09-01T00:40:20,830 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml' 2026-09-01T00:40:20,832 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml' 2026-09-01T00:40:20,833 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py' 2026-09-01T00:40:20,836 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml' 2026-09-01T00:40:20,837 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml' 2026-09-01T00:40:20,838 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml' 2026-09-01T00:40:20,840 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml' 2026-09-01T00:40:20,841 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml' 2026-09-01T00:40:20,842 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml' 2026-09-01T00:40:20,843 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml' 2026-09-01T00:40:20,845 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml' 2026-09-01T00:40:20,846 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml' 2026-09-01T00:40:20,847 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml' 2026-09-01T00:40:20,849 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml' 2026-09-01T00:40:20,850 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml' 2026-09-01T00:40:20,851 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml' 2026-09-01T00:40:20,852 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml' 2026-09-01T00:40:20,854 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml' 2026-09-01T00:40:20,855 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml' 2026-09-01T00:40:20,857 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml' 2026-09-01T00:40:20,858 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml' 2026-09-01T00:40:20,859 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml' 2026-09-01T00:40:20,860 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml' 2026-09-01T00:40:20,862 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml' 2026-09-01T00:40:20,863 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml' 2026-09-01T00:40:20,864 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml' 2026-09-01T00:40:20,865 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml' 2026-09-01T00:40:20,866 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml' 2026-09-01T00:40:20,868 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml' 2026-09-01T00:40:20,869 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml' 2026-09-01T00:40:20,870 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml' 2026-09-01T00:40:20,871 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml' 2026-09-01T00:40:20,873 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml' 2026-09-01T00:40:20,874 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml' 2026-09-01T00:40:20,875 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml' 2026-09-01T00:40:20,876 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml' 2026-09-01T00:40:20,878 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml' 2026-09-01T00:40:20,879 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml' 2026-09-01T00:40:20,880 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml' 2026-09-01T00:40:20,881 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml' 2026-09-01T00:40:20,882 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml' 2026-09-01T00:40:20,883 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml' 2026-09-01T00:40:20,884 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml' 2026-09-01T00:40:20,886 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml' 2026-09-01T00:40:20,887 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml' 2026-09-01T00:40:20,889 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml' 2026-09-01T00:40:20,890 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml' 2026-09-01T00:40:20,891 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml' 2026-09-01T00:40:20,893 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml' 2026-09-01T00:40:20,894 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml' 2026-09-01T00:40:20,895 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml' 2026-09-01T00:40:20,897 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml' 2026-09-01T00:40:20,898 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml' 2026-09-01T00:40:20,899 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml' 2026-09-01T00:40:20,901 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml' 2026-09-01T00:40:20,902 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml' 2026-09-01T00:40:20,903 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml' 2026-09-01T00:40:20,905 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml' 2026-09-01T00:40:20,906 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml' 2026-09-01T00:40:20,907 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml' 2026-09-01T00:40:20,908 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml' 2026-09-01T00:40:20,909 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml' 2026-09-01T00:40:20,911 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py' 2026-09-01T00:40:20,914 adding 'lm_eval/tasks/arabicmmlu/README.md' 2026-09-01T00:40:20,915 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml' 2026-09-01T00:40:20,916 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml' 2026-09-01T00:40:20,917 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml' 2026-09-01T00:40:20,918 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml' 2026-09-01T00:40:20,919 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml' 2026-09-01T00:40:20,921 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml' 2026-09-01T00:40:20,922 adding 'lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml' 2026-09-01T00:40:20,923 adding 'lm_eval/tasks/arabicmmlu/_generate_configs.py' 2026-09-01T00:40:20,924 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml' 2026-09-01T00:40:20,925 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml' 2026-09-01T00:40:20,927 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml' 2026-09-01T00:40:20,928 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml' 2026-09-01T00:40:20,929 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml' 2026-09-01T00:40:20,930 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml' 2026-09-01T00:40:20,931 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml' 2026-09-01T00:40:20,932 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml' 2026-09-01T00:40:20,933 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml' 2026-09-01T00:40:20,934 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml' 2026-09-01T00:40:20,935 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml' 2026-09-01T00:40:20,937 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml' 2026-09-01T00:40:20,938 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml' 2026-09-01T00:40:20,939 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml' 2026-09-01T00:40:20,940 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml' 2026-09-01T00:40:20,941 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml' 2026-09-01T00:40:20,942 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml' 2026-09-01T00:40:20,943 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml' 2026-09-01T00:40:20,945 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml' 2026-09-01T00:40:20,946 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml' 2026-09-01T00:40:20,947 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml' 2026-09-01T00:40:20,948 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml' 2026-09-01T00:40:20,949 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml' 2026-09-01T00:40:20,951 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml' 2026-09-01T00:40:20,952 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml' 2026-09-01T00:40:20,953 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml' 2026-09-01T00:40:20,954 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml' 2026-09-01T00:40:20,956 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml' 2026-09-01T00:40:20,957 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml' 2026-09-01T00:40:20,958 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml' 2026-09-01T00:40:20,959 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml' 2026-09-01T00:40:20,960 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml' 2026-09-01T00:40:20,962 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml' 2026-09-01T00:40:20,963 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml' 2026-09-01T00:40:20,964 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml' 2026-09-01T00:40:20,965 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml' 2026-09-01T00:40:20,967 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml' 2026-09-01T00:40:20,968 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml' 2026-09-01T00:40:20,969 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml' 2026-09-01T00:40:20,970 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml' 2026-09-01T00:40:20,971 adding 'lm_eval/tasks/arabicmmlu/utils.py' 2026-09-01T00:40:20,973 adding 'lm_eval/tasks/aradice/README.md' 2026-09-01T00:40:20,974 adding 'lm_eval/tasks/aradice/aradice.yaml' 2026-09-01T00:40:20,978 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml' 2026-09-01T00:40:20,979 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml' 2026-09-01T00:40:20,980 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml' 2026-09-01T00:40:20,981 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml' 2026-09-01T00:40:20,983 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml' 2026-09-01T00:40:20,984 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml' 2026-09-01T00:40:20,985 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml' 2026-09-01T00:40:20,986 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml' 2026-09-01T00:40:20,988 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml' 2026-09-01T00:40:20,989 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml' 2026-09-01T00:40:20,990 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml' 2026-09-01T00:40:20,991 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml' 2026-09-01T00:40:20,992 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml' 2026-09-01T00:40:20,994 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml' 2026-09-01T00:40:20,995 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml' 2026-09-01T00:40:20,996 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml' 2026-09-01T00:40:20,997 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml' 2026-09-01T00:40:20,999 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml' 2026-09-01T00:40:21,000 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml' 2026-09-01T00:40:21,001 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml' 2026-09-01T00:40:21,003 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml' 2026-09-01T00:40:21,004 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml' 2026-09-01T00:40:21,005 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml' 2026-09-01T00:40:21,006 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml' 2026-09-01T00:40:21,008 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml' 2026-09-01T00:40:21,009 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml' 2026-09-01T00:40:21,010 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml' 2026-09-01T00:40:21,011 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml' 2026-09-01T00:40:21,013 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml' 2026-09-01T00:40:21,014 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml' 2026-09-01T00:40:21,015 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml' 2026-09-01T00:40:21,016 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml' 2026-09-01T00:40:21,017 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml' 2026-09-01T00:40:21,018 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml' 2026-09-01T00:40:21,020 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml' 2026-09-01T00:40:21,021 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml' 2026-09-01T00:40:21,022 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml' 2026-09-01T00:40:21,023 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml' 2026-09-01T00:40:21,025 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml' 2026-09-01T00:40:21,026 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml' 2026-09-01T00:40:21,027 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml' 2026-09-01T00:40:21,028 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml' 2026-09-01T00:40:21,029 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py' 2026-09-01T00:40:21,031 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py' 2026-09-01T00:40:21,034 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml' 2026-09-01T00:40:21,035 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml' 2026-09-01T00:40:21,036 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml' 2026-09-01T00:40:21,037 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml' 2026-09-01T00:40:21,038 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml' 2026-09-01T00:40:21,040 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml' 2026-09-01T00:40:21,041 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml' 2026-09-01T00:40:21,042 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml' 2026-09-01T00:40:21,043 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml' 2026-09-01T00:40:21,045 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml' 2026-09-01T00:40:21,046 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml' 2026-09-01T00:40:21,047 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml' 2026-09-01T00:40:21,048 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml' 2026-09-01T00:40:21,049 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml' 2026-09-01T00:40:21,051 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml' 2026-09-01T00:40:21,052 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml' 2026-09-01T00:40:21,053 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml' 2026-09-01T00:40:21,054 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml' 2026-09-01T00:40:21,055 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml' 2026-09-01T00:40:21,056 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml' 2026-09-01T00:40:21,058 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml' 2026-09-01T00:40:21,059 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml' 2026-09-01T00:40:21,060 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml' 2026-09-01T00:40:21,061 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml' 2026-09-01T00:40:21,062 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml' 2026-09-01T00:40:21,064 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml' 2026-09-01T00:40:21,065 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml' 2026-09-01T00:40:21,066 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml' 2026-09-01T00:40:21,067 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml' 2026-09-01T00:40:21,069 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml' 2026-09-01T00:40:21,070 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml' 2026-09-01T00:40:21,071 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml' 2026-09-01T00:40:21,072 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml' 2026-09-01T00:40:21,073 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml' 2026-09-01T00:40:21,075 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml' 2026-09-01T00:40:21,076 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml' 2026-09-01T00:40:21,077 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml' 2026-09-01T00:40:21,078 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml' 2026-09-01T00:40:21,079 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml' 2026-09-01T00:40:21,081 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml' 2026-09-01T00:40:21,082 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml' 2026-09-01T00:40:21,083 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml' 2026-09-01T00:40:21,084 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py' 2026-09-01T00:40:21,086 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py' 2026-09-01T00:40:21,088 adding 'lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml' 2026-09-01T00:40:21,089 adding 'lm_eval/tasks/aradice/boolq/EGY/metrics.py' 2026-09-01T00:40:21,090 adding 'lm_eval/tasks/aradice/boolq/EGY/utils.py' 2026-09-01T00:40:21,092 adding 'lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml' 2026-09-01T00:40:21,093 adding 'lm_eval/tasks/aradice/boolq/ENG/metrics.py' 2026-09-01T00:40:21,095 adding 'lm_eval/tasks/aradice/boolq/ENG/utils.py' 2026-09-01T00:40:21,097 adding 'lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml' 2026-09-01T00:40:21,098 adding 'lm_eval/tasks/aradice/boolq/LEV/metrics.py' 2026-09-01T00:40:21,099 adding 'lm_eval/tasks/aradice/boolq/LEV/utils.py' 2026-09-01T00:40:21,101 adding 'lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml' 2026-09-01T00:40:21,102 adding 'lm_eval/tasks/aradice/boolq/MSA/metrics.py' 2026-09-01T00:40:21,103 adding 'lm_eval/tasks/aradice/boolq/MSA/utils.py' 2026-09-01T00:40:21,105 adding 'lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml' 2026-09-01T00:40:21,106 adding 'lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml' 2026-09-01T00:40:21,107 adding 'lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml' 2026-09-01T00:40:21,109 adding 'lm_eval/tasks/aradice/cultural-benchmark/metrics.py' 2026-09-01T00:40:21,110 adding 'lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml' 2026-09-01T00:40:21,111 adding 'lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml' 2026-09-01T00:40:21,112 adding 'lm_eval/tasks/aradice/cultural-benchmark/syria.yaml' 2026-09-01T00:40:21,113 adding 'lm_eval/tasks/aradice/cultural-benchmark/utils.py' 2026-09-01T00:40:21,115 adding 'lm_eval/tasks/aradice/openbookqa/metrics.py' 2026-09-01T00:40:21,116 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml' 2026-09-01T00:40:21,117 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml' 2026-09-01T00:40:21,118 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml' 2026-09-01T00:40:21,120 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml' 2026-09-01T00:40:21,121 adding 'lm_eval/tasks/aradice/openbookqa/utils.py' 2026-09-01T00:40:21,123 adding 'lm_eval/tasks/aradice/piqa/metrics.py' 2026-09-01T00:40:21,124 adding 'lm_eval/tasks/aradice/piqa/piqa_egy.yaml' 2026-09-01T00:40:21,125 adding 'lm_eval/tasks/aradice/piqa/piqa_eng.yaml' 2026-09-01T00:40:21,126 adding 'lm_eval/tasks/aradice/piqa/piqa_lev.yaml' 2026-09-01T00:40:21,127 adding 'lm_eval/tasks/aradice/piqa/piqa_msa.yaml' 2026-09-01T00:40:21,129 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py' 2026-09-01T00:40:21,131 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml' 2026-09-01T00:40:21,132 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml' 2026-09-01T00:40:21,133 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml' 2026-09-01T00:40:21,134 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml' 2026-09-01T00:40:21,136 adding 'lm_eval/tasks/aradice/winogrande/metrics.py' 2026-09-01T00:40:21,137 adding 'lm_eval/tasks/aradice/winogrande/utils.py' 2026-09-01T00:40:21,139 adding 'lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml' 2026-09-01T00:40:21,140 adding 'lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml' 2026-09-01T00:40:21,141 adding 'lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml' 2026-09-01T00:40:21,142 adding 'lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml' 2026-09-01T00:40:21,144 adding 'lm_eval/tasks/arc/README.md' 2026-09-01T00:40:21,146 adding 'lm_eval/tasks/arc/arc_challenge.yaml' 2026-09-01T00:40:21,147 adding 'lm_eval/tasks/arc/arc_challenge_chat.yaml' 2026-09-01T00:40:21,148 adding 'lm_eval/tasks/arc/arc_easy.yaml' 2026-09-01T00:40:21,150 adding 'lm_eval/tasks/arc_mt/README.md' 2026-09-01T00:40:21,151 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml' 2026-09-01T00:40:21,152 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml' 2026-09-01T00:40:21,154 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml' 2026-09-01T00:40:21,155 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml' 2026-09-01T00:40:21,156 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml' 2026-09-01T00:40:21,157 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml' 2026-09-01T00:40:21,158 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml' 2026-09-01T00:40:21,160 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml' 2026-09-01T00:40:21,161 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml' 2026-09-01T00:40:21,162 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml' 2026-09-01T00:40:21,163 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml' 2026-09-01T00:40:21,164 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml' 2026-09-01T00:40:21,166 adding 'lm_eval/tasks/arithmetic/README.md' 2026-09-01T00:40:21,168 adding 'lm_eval/tasks/arithmetic/arithmetic_1dc.yaml' 2026-09-01T00:40:21,169 adding 'lm_eval/tasks/arithmetic/arithmetic_2da.yaml' 2026-09-01T00:40:21,170 adding 'lm_eval/tasks/arithmetic/arithmetic_2dm.yaml' 2026-09-01T00:40:21,171 adding 'lm_eval/tasks/arithmetic/arithmetic_2ds.yaml' 2026-09-01T00:40:21,172 adding 'lm_eval/tasks/arithmetic/arithmetic_3da.yaml' 2026-09-01T00:40:21,173 adding 'lm_eval/tasks/arithmetic/arithmetic_3ds.yaml' 2026-09-01T00:40:21,174 adding 'lm_eval/tasks/arithmetic/arithmetic_4da.yaml' 2026-09-01T00:40:21,175 adding 'lm_eval/tasks/arithmetic/arithmetic_4ds.yaml' 2026-09-01T00:40:21,177 adding 'lm_eval/tasks/arithmetic/arithmetic_5da.yaml' 2026-09-01T00:40:21,178 adding 'lm_eval/tasks/arithmetic/arithmetic_5ds.yaml' 2026-09-01T00:40:21,179 adding 'lm_eval/tasks/arithmetic/utils.py' 2026-09-01T00:40:21,181 adding 'lm_eval/tasks/asdiv/README.md' 2026-09-01T00:40:21,183 adding 'lm_eval/tasks/asdiv/asdiv-cot-llama.yaml' 2026-09-01T00:40:21,184 adding 'lm_eval/tasks/asdiv/default.yaml' 2026-09-01T00:40:21,186 adding 'lm_eval/tasks/babi/README.md' 2026-09-01T00:40:21,187 adding 'lm_eval/tasks/babi/babi.yaml' 2026-09-01T00:40:21,190 adding 'lm_eval/tasks/babilong/README.md' 2026-09-01T00:40:21,191 adding 'lm_eval/tasks/babilong/_babilong_common_yaml' 2026-09-01T00:40:21,192 adding 'lm_eval/tasks/babilong/babilong.yaml' 2026-09-01T00:40:21,193 adding 'lm_eval/tasks/babilong/babilong_longctx.yaml' 2026-09-01T00:40:21,194 adding 'lm_eval/tasks/babilong/babilong_qa1.yaml' 2026-09-01T00:40:21,196 adding 'lm_eval/tasks/babilong/babilong_qa10.yaml' 2026-09-01T00:40:21,197 adding 'lm_eval/tasks/babilong/babilong_qa11.yaml' 2026-09-01T00:40:21,198 adding 'lm_eval/tasks/babilong/babilong_qa12.yaml' 2026-09-01T00:40:21,199 adding 'lm_eval/tasks/babilong/babilong_qa13.yaml' 2026-09-01T00:40:21,201 adding 'lm_eval/tasks/babilong/babilong_qa14.yaml' 2026-09-01T00:40:21,202 adding 'lm_eval/tasks/babilong/babilong_qa15.yaml' 2026-09-01T00:40:21,203 adding 'lm_eval/tasks/babilong/babilong_qa16.yaml' 2026-09-01T00:40:21,204 adding 'lm_eval/tasks/babilong/babilong_qa17.yaml' 2026-09-01T00:40:21,206 adding 'lm_eval/tasks/babilong/babilong_qa18.yaml' 2026-09-01T00:40:21,207 adding 'lm_eval/tasks/babilong/babilong_qa19.yaml' 2026-09-01T00:40:21,208 adding 'lm_eval/tasks/babilong/babilong_qa2.yaml' 2026-09-01T00:40:21,210 adding 'lm_eval/tasks/babilong/babilong_qa20.yaml' 2026-09-01T00:40:21,211 adding 'lm_eval/tasks/babilong/babilong_qa3.yaml' 2026-09-01T00:40:21,212 adding 'lm_eval/tasks/babilong/babilong_qa4.yaml' 2026-09-01T00:40:21,213 adding 'lm_eval/tasks/babilong/babilong_qa5.yaml' 2026-09-01T00:40:21,215 adding 'lm_eval/tasks/babilong/babilong_qa6.yaml' 2026-09-01T00:40:21,216 adding 'lm_eval/tasks/babilong/babilong_qa7.yaml' 2026-09-01T00:40:21,217 adding 'lm_eval/tasks/babilong/babilong_qa8.yaml' 2026-09-01T00:40:21,218 adding 'lm_eval/tasks/babilong/babilong_qa9.yaml' 2026-09-01T00:40:21,220 adding 'lm_eval/tasks/babilong/common_utils.py' 2026-09-01T00:40:21,222 adding 'lm_eval/tasks/bangla/README.md' 2026-09-01T00:40:21,223 adding 'lm_eval/tasks/bangla/bangla_boolqa.yaml' 2026-09-01T00:40:21,224 adding 'lm_eval/tasks/bangla/bangla_commonsenseqa.yaml' 2026-09-01T00:40:21,225 adding 'lm_eval/tasks/bangla/bangla_mmlu.yaml' 2026-09-01T00:40:21,227 adding 'lm_eval/tasks/bangla/bangla_openbookqa.yaml' 2026-09-01T00:40:21,228 adding 'lm_eval/tasks/bangla/bangla_piqa.yaml' 2026-09-01T00:40:21,230 adding 'lm_eval/tasks/basque_bench/README.md' 2026-09-01T00:40:21,231 adding 'lm_eval/tasks/basque_bench/arc_eu_challenge.yaml' 2026-09-01T00:40:21,232 adding 'lm_eval/tasks/basque_bench/arc_eu_easy.yaml' 2026-09-01T00:40:21,234 adding 'lm_eval/tasks/basque_bench/basque_bench.yaml' 2026-09-01T00:40:21,235 adding 'lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml' 2026-09-01T00:40:21,237 adding 'lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml' 2026-09-01T00:40:21,238 adding 'lm_eval/tasks/basque_bench/paws_eu.yaml' 2026-09-01T00:40:21,239 adding 'lm_eval/tasks/basque_bench/piqa_eu.yaml' 2026-09-01T00:40:21,240 adding 'lm_eval/tasks/basque_bench/utils.py' 2026-09-01T00:40:21,241 adding 'lm_eval/tasks/basque_bench/wnli_eu.yaml' 2026-09-01T00:40:21,242 adding 'lm_eval/tasks/basque_bench/xcopa_eu.yaml' 2026-09-01T00:40:21,244 adding 'lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml' 2026-09-01T00:40:21,246 adding 'lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py' 2026-09-01T00:40:21,247 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml' 2026-09-01T00:40:21,248 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml' 2026-09-01T00:40:21,249 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml' 2026-09-01T00:40:21,250 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml' 2026-09-01T00:40:21,251 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml' 2026-09-01T00:40:21,253 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml' 2026-09-01T00:40:21,254 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml' 2026-09-01T00:40:21,255 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml' 2026-09-01T00:40:21,256 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml' 2026-09-01T00:40:21,258 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml' 2026-09-01T00:40:21,259 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml' 2026-09-01T00:40:21,260 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml' 2026-09-01T00:40:21,261 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml' 2026-09-01T00:40:21,262 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml' 2026-09-01T00:40:21,263 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml' 2026-09-01T00:40:21,264 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml' 2026-09-01T00:40:21,266 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml' 2026-09-01T00:40:21,268 adding 'lm_eval/tasks/basqueglue/README.md' 2026-09-01T00:40:21,269 adding 'lm_eval/tasks/basqueglue/bec.yaml' 2026-09-01T00:40:21,270 adding 'lm_eval/tasks/basqueglue/bhtc.yaml' 2026-09-01T00:40:21,271 adding 'lm_eval/tasks/basqueglue/coref.yaml' 2026-09-01T00:40:21,273 adding 'lm_eval/tasks/basqueglue/qnli.yaml' 2026-09-01T00:40:21,274 adding 'lm_eval/tasks/basqueglue/utils.py' 2026-09-01T00:40:21,275 adding 'lm_eval/tasks/basqueglue/vaxx.yaml' 2026-09-01T00:40:21,277 adding 'lm_eval/tasks/basqueglue/wic.yaml' 2026-09-01T00:40:21,278 adding 'lm_eval/tasks/bbh/README.md' 2026-09-01T00:40:21,280 adding 'lm_eval/tasks/bbh/_generate_configs.py' 2026-09-01T00:40:21,282 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml' 2026-09-01T00:40:21,283 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml' 2026-09-01T00:40:21,285 adding 'lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml' 2026-09-01T00:40:21,286 adding 'lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml' 2026-09-01T00:40:21,288 adding 'lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml' 2026-09-01T00:40:21,289 adding 'lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml' 2026-09-01T00:40:21,291 adding 'lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml' 2026-09-01T00:40:21,293 adding 'lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml' 2026-09-01T00:40:21,294 adding 'lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml' 2026-09-01T00:40:21,296 adding 'lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml' 2026-09-01T00:40:21,298 adding 'lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml' 2026-09-01T00:40:21,299 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml' 2026-09-01T00:40:21,301 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml' 2026-09-01T00:40:21,302 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml' 2026-09-01T00:40:21,304 adding 'lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml' 2026-09-01T00:40:21,305 adding 'lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml' 2026-09-01T00:40:21,307 adding 'lm_eval/tasks/bbh/cot_fewshot/navigate.yaml' 2026-09-01T00:40:21,308 adding 'lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml' 2026-09-01T00:40:21,309 adding 'lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml' 2026-09-01T00:40:21,311 adding 'lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml' 2026-09-01T00:40:21,312 adding 'lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml' 2026-09-01T00:40:21,314 adding 'lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml' 2026-09-01T00:40:21,315 adding 'lm_eval/tasks/bbh/cot_fewshot/snarks.yaml' 2026-09-01T00:40:21,316 adding 'lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml' 2026-09-01T00:40:21,318 adding 'lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml' 2026-09-01T00:40:21,319 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:40:21,321 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:40:21,322 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:40:21,323 adding 'lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml' 2026-09-01T00:40:21,325 adding 'lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml' 2026-09-01T00:40:21,327 adding 'lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml' 2026-09-01T00:40:21,328 adding 'lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml' 2026-09-01T00:40:21,329 adding 'lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml' 2026-09-01T00:40:21,331 adding 'lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml' 2026-09-01T00:40:21,332 adding 'lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml' 2026-09-01T00:40:21,333 adding 'lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml' 2026-09-01T00:40:21,334 adding 'lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml' 2026-09-01T00:40:21,335 adding 'lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml' 2026-09-01T00:40:21,337 adding 'lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml' 2026-09-01T00:40:21,338 adding 'lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml' 2026-09-01T00:40:21,339 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml' 2026-09-01T00:40:21,340 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml' 2026-09-01T00:40:21,342 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml' 2026-09-01T00:40:21,343 adding 'lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml' 2026-09-01T00:40:21,344 adding 'lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml' 2026-09-01T00:40:21,345 adding 'lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml' 2026-09-01T00:40:21,347 adding 'lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml' 2026-09-01T00:40:21,348 adding 'lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml' 2026-09-01T00:40:21,349 adding 'lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml' 2026-09-01T00:40:21,350 adding 'lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml' 2026-09-01T00:40:21,352 adding 'lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml' 2026-09-01T00:40:21,353 adding 'lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml' 2026-09-01T00:40:21,354 adding 'lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml' 2026-09-01T00:40:21,356 adding 'lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml' 2026-09-01T00:40:21,357 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:40:21,358 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:40:21,359 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:40:21,361 adding 'lm_eval/tasks/bbh/cot_zeroshot/utils.py' 2026-09-01T00:40:21,362 adding 'lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml' 2026-09-01T00:40:21,364 adding 'lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml' 2026-09-01T00:40:21,366 adding 'lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml' 2026-09-01T00:40:21,367 adding 'lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml' 2026-09-01T00:40:21,368 adding 'lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml' 2026-09-01T00:40:21,369 adding 'lm_eval/tasks/bbh/fewshot/causal_judgement.yaml' 2026-09-01T00:40:21,371 adding 'lm_eval/tasks/bbh/fewshot/date_understanding.yaml' 2026-09-01T00:40:21,372 adding 'lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml' 2026-09-01T00:40:21,373 adding 'lm_eval/tasks/bbh/fewshot/dyck_languages.yaml' 2026-09-01T00:40:21,374 adding 'lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml' 2026-09-01T00:40:21,375 adding 'lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml' 2026-09-01T00:40:21,377 adding 'lm_eval/tasks/bbh/fewshot/hyperbaton.yaml' 2026-09-01T00:40:21,378 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml' 2026-09-01T00:40:21,379 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml' 2026-09-01T00:40:21,380 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml' 2026-09-01T00:40:21,382 adding 'lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml' 2026-09-01T00:40:21,383 adding 'lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml' 2026-09-01T00:40:21,384 adding 'lm_eval/tasks/bbh/fewshot/navigate.yaml' 2026-09-01T00:40:21,385 adding 'lm_eval/tasks/bbh/fewshot/object_counting.yaml' 2026-09-01T00:40:21,387 adding 'lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml' 2026-09-01T00:40:21,388 adding 'lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml' 2026-09-01T00:40:21,389 adding 'lm_eval/tasks/bbh/fewshot/ruin_names.yaml' 2026-09-01T00:40:21,390 adding 'lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml' 2026-09-01T00:40:21,392 adding 'lm_eval/tasks/bbh/fewshot/snarks.yaml' 2026-09-01T00:40:21,393 adding 'lm_eval/tasks/bbh/fewshot/sports_understanding.yaml' 2026-09-01T00:40:21,394 adding 'lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml' 2026-09-01T00:40:21,396 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:40:21,397 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:40:21,398 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:40:21,399 adding 'lm_eval/tasks/bbh/fewshot/web_of_lies.yaml' 2026-09-01T00:40:21,401 adding 'lm_eval/tasks/bbh/fewshot/word_sorting.yaml' 2026-09-01T00:40:21,403 adding 'lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml' 2026-09-01T00:40:21,404 adding 'lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml' 2026-09-01T00:40:21,405 adding 'lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml' 2026-09-01T00:40:21,407 adding 'lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml' 2026-09-01T00:40:21,408 adding 'lm_eval/tasks/bbh/zeroshot/date_understanding.yaml' 2026-09-01T00:40:21,409 adding 'lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml' 2026-09-01T00:40:21,410 adding 'lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml' 2026-09-01T00:40:21,412 adding 'lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml' 2026-09-01T00:40:21,413 adding 'lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml' 2026-09-01T00:40:21,414 adding 'lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml' 2026-09-01T00:40:21,415 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml' 2026-09-01T00:40:21,417 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml' 2026-09-01T00:40:21,418 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml' 2026-09-01T00:40:21,419 adding 'lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml' 2026-09-01T00:40:21,420 adding 'lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml' 2026-09-01T00:40:21,422 adding 'lm_eval/tasks/bbh/zeroshot/navigate.yaml' 2026-09-01T00:40:21,423 adding 'lm_eval/tasks/bbh/zeroshot/object_counting.yaml' 2026-09-01T00:40:21,424 adding 'lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml' 2026-09-01T00:40:21,425 adding 'lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml' 2026-09-01T00:40:21,427 adding 'lm_eval/tasks/bbh/zeroshot/ruin_names.yaml' 2026-09-01T00:40:21,428 adding 'lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml' 2026-09-01T00:40:21,429 adding 'lm_eval/tasks/bbh/zeroshot/snarks.yaml' 2026-09-01T00:40:21,430 adding 'lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml' 2026-09-01T00:40:21,431 adding 'lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml' 2026-09-01T00:40:21,433 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:40:21,434 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:40:21,435 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:40:21,437 adding 'lm_eval/tasks/bbh/zeroshot/utils.py' 2026-09-01T00:40:21,438 adding 'lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml' 2026-09-01T00:40:21,439 adding 'lm_eval/tasks/bbh/zeroshot/word_sorting.yaml' 2026-09-01T00:40:21,441 adding 'lm_eval/tasks/bbq/README.md' 2026-09-01T00:40:21,443 adding 'lm_eval/tasks/bbq/bbq_generate.yaml' 2026-09-01T00:40:21,444 adding 'lm_eval/tasks/bbq/bbq_generate_ambig.yaml' 2026-09-01T00:40:21,445 adding 'lm_eval/tasks/bbq/bbq_generate_disambig.yaml' 2026-09-01T00:40:21,446 adding 'lm_eval/tasks/bbq/bbq_multiple_choice.yaml' 2026-09-01T00:40:21,448 adding 'lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml' 2026-09-01T00:40:21,449 adding 'lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml' 2026-09-01T00:40:21,451 adding 'lm_eval/tasks/bbq/utils.py' 2026-09-01T00:40:21,453 adding 'lm_eval/tasks/bear/README.md' 2026-09-01T00:40:21,454 adding 'lm_eval/tasks/bear/bear.yaml' 2026-09-01T00:40:21,456 adding 'lm_eval/tasks/bear/bear_big.yaml' 2026-09-01T00:40:21,460 adding 'lm_eval/tasks/belebele/README.md' 2026-09-01T00:40:21,461 adding 'lm_eval/tasks/belebele/_belebele.yaml' 2026-09-01T00:40:21,462 adding 'lm_eval/tasks/belebele/_default_template_yaml' 2026-09-01T00:40:21,463 adding 'lm_eval/tasks/belebele/_generate_configs.py' 2026-09-01T00:40:21,465 adding 'lm_eval/tasks/belebele/belebele_acm_Arab.yaml' 2026-09-01T00:40:21,466 adding 'lm_eval/tasks/belebele/belebele_afr_Latn.yaml' 2026-09-01T00:40:21,467 adding 'lm_eval/tasks/belebele/belebele_als_Latn.yaml' 2026-09-01T00:40:21,468 adding 'lm_eval/tasks/belebele/belebele_amh_Ethi.yaml' 2026-09-01T00:40:21,469 adding 'lm_eval/tasks/belebele/belebele_apc_Arab.yaml' 2026-09-01T00:40:21,470 adding 'lm_eval/tasks/belebele/belebele_arb_Arab.yaml' 2026-09-01T00:40:21,471 adding 'lm_eval/tasks/belebele/belebele_arb_Latn.yaml' 2026-09-01T00:40:21,473 adding 'lm_eval/tasks/belebele/belebele_ars_Arab.yaml' 2026-09-01T00:40:21,474 adding 'lm_eval/tasks/belebele/belebele_ary_Arab.yaml' 2026-09-01T00:40:21,475 adding 'lm_eval/tasks/belebele/belebele_arz_Arab.yaml' 2026-09-01T00:40:21,476 adding 'lm_eval/tasks/belebele/belebele_asm_Beng.yaml' 2026-09-01T00:40:21,477 adding 'lm_eval/tasks/belebele/belebele_azj_Latn.yaml' 2026-09-01T00:40:21,478 adding 'lm_eval/tasks/belebele/belebele_bam_Latn.yaml' 2026-09-01T00:40:21,480 adding 'lm_eval/tasks/belebele/belebele_ben_Beng.yaml' 2026-09-01T00:40:21,481 adding 'lm_eval/tasks/belebele/belebele_ben_Latn.yaml' 2026-09-01T00:40:21,482 adding 'lm_eval/tasks/belebele/belebele_bod_Tibt.yaml' 2026-09-01T00:40:21,483 adding 'lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml' 2026-09-01T00:40:21,484 adding 'lm_eval/tasks/belebele/belebele_cat_Latn.yaml' 2026-09-01T00:40:21,486 adding 'lm_eval/tasks/belebele/belebele_ceb_Latn.yaml' 2026-09-01T00:40:21,487 adding 'lm_eval/tasks/belebele/belebele_ces_Latn.yaml' 2026-09-01T00:40:21,488 adding 'lm_eval/tasks/belebele/belebele_ckb_Arab.yaml' 2026-09-01T00:40:21,489 adding 'lm_eval/tasks/belebele/belebele_dan_Latn.yaml' 2026-09-01T00:40:21,490 adding 'lm_eval/tasks/belebele/belebele_deu_Latn.yaml' 2026-09-01T00:40:21,492 adding 'lm_eval/tasks/belebele/belebele_ell_Grek.yaml' 2026-09-01T00:40:21,493 adding 'lm_eval/tasks/belebele/belebele_eng_Latn.yaml' 2026-09-01T00:40:21,494 adding 'lm_eval/tasks/belebele/belebele_est_Latn.yaml' 2026-09-01T00:40:21,495 adding 'lm_eval/tasks/belebele/belebele_eus_Latn.yaml' 2026-09-01T00:40:21,496 adding 'lm_eval/tasks/belebele/belebele_fin_Latn.yaml' 2026-09-01T00:40:21,497 adding 'lm_eval/tasks/belebele/belebele_fra_Latn.yaml' 2026-09-01T00:40:21,498 adding 'lm_eval/tasks/belebele/belebele_fuv_Latn.yaml' 2026-09-01T00:40:21,499 adding 'lm_eval/tasks/belebele/belebele_gaz_Latn.yaml' 2026-09-01T00:40:21,500 adding 'lm_eval/tasks/belebele/belebele_grn_Latn.yaml' 2026-09-01T00:40:21,502 adding 'lm_eval/tasks/belebele/belebele_guj_Gujr.yaml' 2026-09-01T00:40:21,503 adding 'lm_eval/tasks/belebele/belebele_hat_Latn.yaml' 2026-09-01T00:40:21,504 adding 'lm_eval/tasks/belebele/belebele_hau_Latn.yaml' 2026-09-01T00:40:21,505 adding 'lm_eval/tasks/belebele/belebele_heb_Hebr.yaml' 2026-09-01T00:40:21,506 adding 'lm_eval/tasks/belebele/belebele_hin_Deva.yaml' 2026-09-01T00:40:21,507 adding 'lm_eval/tasks/belebele/belebele_hin_Latn.yaml' 2026-09-01T00:40:21,509 adding 'lm_eval/tasks/belebele/belebele_hrv_Latn.yaml' 2026-09-01T00:40:21,510 adding 'lm_eval/tasks/belebele/belebele_hun_Latn.yaml' 2026-09-01T00:40:21,511 adding 'lm_eval/tasks/belebele/belebele_hye_Armn.yaml' 2026-09-01T00:40:21,512 adding 'lm_eval/tasks/belebele/belebele_ibo_Latn.yaml' 2026-09-01T00:40:21,513 adding 'lm_eval/tasks/belebele/belebele_ilo_Latn.yaml' 2026-09-01T00:40:21,514 adding 'lm_eval/tasks/belebele/belebele_ind_Latn.yaml' 2026-09-01T00:40:21,515 adding 'lm_eval/tasks/belebele/belebele_isl_Latn.yaml' 2026-09-01T00:40:21,517 adding 'lm_eval/tasks/belebele/belebele_ita_Latn.yaml' 2026-09-01T00:40:21,518 adding 'lm_eval/tasks/belebele/belebele_jav_Latn.yaml' 2026-09-01T00:40:21,519 adding 'lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml' 2026-09-01T00:40:21,520 adding 'lm_eval/tasks/belebele/belebele_kac_Latn.yaml' 2026-09-01T00:40:21,521 adding 'lm_eval/tasks/belebele/belebele_kan_Knda.yaml' 2026-09-01T00:40:21,522 adding 'lm_eval/tasks/belebele/belebele_kat_Geor.yaml' 2026-09-01T00:40:21,524 adding 'lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml' 2026-09-01T00:40:21,525 adding 'lm_eval/tasks/belebele/belebele_kea_Latn.yaml' 2026-09-01T00:40:21,526 adding 'lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml' 2026-09-01T00:40:21,527 adding 'lm_eval/tasks/belebele/belebele_khm_Khmr.yaml' 2026-09-01T00:40:21,528 adding 'lm_eval/tasks/belebele/belebele_kin_Latn.yaml' 2026-09-01T00:40:21,529 adding 'lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml' 2026-09-01T00:40:21,530 adding 'lm_eval/tasks/belebele/belebele_kor_Hang.yaml' 2026-09-01T00:40:21,532 adding 'lm_eval/tasks/belebele/belebele_lao_Laoo.yaml' 2026-09-01T00:40:21,533 adding 'lm_eval/tasks/belebele/belebele_lin_Latn.yaml' 2026-09-01T00:40:21,534 adding 'lm_eval/tasks/belebele/belebele_lit_Latn.yaml' 2026-09-01T00:40:21,535 adding 'lm_eval/tasks/belebele/belebele_lug_Latn.yaml' 2026-09-01T00:40:21,536 adding 'lm_eval/tasks/belebele/belebele_luo_Latn.yaml' 2026-09-01T00:40:21,538 adding 'lm_eval/tasks/belebele/belebele_lvs_Latn.yaml' 2026-09-01T00:40:21,539 adding 'lm_eval/tasks/belebele/belebele_mal_Mlym.yaml' 2026-09-01T00:40:21,540 adding 'lm_eval/tasks/belebele/belebele_mar_Deva.yaml' 2026-09-01T00:40:21,541 adding 'lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml' 2026-09-01T00:40:21,542 adding 'lm_eval/tasks/belebele/belebele_mlt_Latn.yaml' 2026-09-01T00:40:21,543 adding 'lm_eval/tasks/belebele/belebele_mri_Latn.yaml' 2026-09-01T00:40:21,545 adding 'lm_eval/tasks/belebele/belebele_mya_Mymr.yaml' 2026-09-01T00:40:21,546 adding 'lm_eval/tasks/belebele/belebele_nld_Latn.yaml' 2026-09-01T00:40:21,547 adding 'lm_eval/tasks/belebele/belebele_nob_Latn.yaml' 2026-09-01T00:40:21,548 adding 'lm_eval/tasks/belebele/belebele_npi_Deva.yaml' 2026-09-01T00:40:21,549 adding 'lm_eval/tasks/belebele/belebele_npi_Latn.yaml' 2026-09-01T00:40:21,550 adding 'lm_eval/tasks/belebele/belebele_nso_Latn.yaml' 2026-09-01T00:40:21,552 adding 'lm_eval/tasks/belebele/belebele_nya_Latn.yaml' 2026-09-01T00:40:21,553 adding 'lm_eval/tasks/belebele/belebele_ory_Orya.yaml' 2026-09-01T00:40:21,554 adding 'lm_eval/tasks/belebele/belebele_pan_Guru.yaml' 2026-09-01T00:40:21,555 adding 'lm_eval/tasks/belebele/belebele_pbt_Arab.yaml' 2026-09-01T00:40:21,556 adding 'lm_eval/tasks/belebele/belebele_pes_Arab.yaml' 2026-09-01T00:40:21,557 adding 'lm_eval/tasks/belebele/belebele_plt_Latn.yaml' 2026-09-01T00:40:21,558 adding 'lm_eval/tasks/belebele/belebele_pol_Latn.yaml' 2026-09-01T00:40:21,559 adding 'lm_eval/tasks/belebele/belebele_por_Latn.yaml' 2026-09-01T00:40:21,561 adding 'lm_eval/tasks/belebele/belebele_ron_Latn.yaml' 2026-09-01T00:40:21,562 adding 'lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml' 2026-09-01T00:40:21,563 adding 'lm_eval/tasks/belebele/belebele_shn_Mymr.yaml' 2026-09-01T00:40:21,564 adding 'lm_eval/tasks/belebele/belebele_sin_Latn.yaml' 2026-09-01T00:40:21,566 adding 'lm_eval/tasks/belebele/belebele_sin_Sinh.yaml' 2026-09-01T00:40:21,567 adding 'lm_eval/tasks/belebele/belebele_slk_Latn.yaml' 2026-09-01T00:40:21,568 adding 'lm_eval/tasks/belebele/belebele_slv_Latn.yaml' 2026-09-01T00:40:21,569 adding 'lm_eval/tasks/belebele/belebele_sna_Latn.yaml' 2026-09-01T00:40:21,570 adding 'lm_eval/tasks/belebele/belebele_snd_Arab.yaml' 2026-09-01T00:40:21,571 adding 'lm_eval/tasks/belebele/belebele_som_Latn.yaml' 2026-09-01T00:40:21,572 adding 'lm_eval/tasks/belebele/belebele_sot_Latn.yaml' 2026-09-01T00:40:21,574 adding 'lm_eval/tasks/belebele/belebele_spa_Latn.yaml' 2026-09-01T00:40:21,575 adding 'lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml' 2026-09-01T00:40:21,576 adding 'lm_eval/tasks/belebele/belebele_ssw_Latn.yaml' 2026-09-01T00:40:21,577 adding 'lm_eval/tasks/belebele/belebele_sun_Latn.yaml' 2026-09-01T00:40:21,578 adding 'lm_eval/tasks/belebele/belebele_swe_Latn.yaml' 2026-09-01T00:40:21,579 adding 'lm_eval/tasks/belebele/belebele_swh_Latn.yaml' 2026-09-01T00:40:21,581 adding 'lm_eval/tasks/belebele/belebele_tam_Taml.yaml' 2026-09-01T00:40:21,582 adding 'lm_eval/tasks/belebele/belebele_tel_Telu.yaml' 2026-09-01T00:40:21,583 adding 'lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml' 2026-09-01T00:40:21,584 adding 'lm_eval/tasks/belebele/belebele_tgl_Latn.yaml' 2026-09-01T00:40:21,586 adding 'lm_eval/tasks/belebele/belebele_tha_Thai.yaml' 2026-09-01T00:40:21,587 adding 'lm_eval/tasks/belebele/belebele_tir_Ethi.yaml' 2026-09-01T00:40:21,588 adding 'lm_eval/tasks/belebele/belebele_tsn_Latn.yaml' 2026-09-01T00:40:21,589 adding 'lm_eval/tasks/belebele/belebele_tso_Latn.yaml' 2026-09-01T00:40:21,590 adding 'lm_eval/tasks/belebele/belebele_tur_Latn.yaml' 2026-09-01T00:40:21,591 adding 'lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml' 2026-09-01T00:40:21,593 adding 'lm_eval/tasks/belebele/belebele_urd_Arab.yaml' 2026-09-01T00:40:21,594 adding 'lm_eval/tasks/belebele/belebele_urd_Latn.yaml' 2026-09-01T00:40:21,595 adding 'lm_eval/tasks/belebele/belebele_uzn_Latn.yaml' 2026-09-01T00:40:21,596 adding 'lm_eval/tasks/belebele/belebele_vie_Latn.yaml' 2026-09-01T00:40:21,597 adding 'lm_eval/tasks/belebele/belebele_war_Latn.yaml' 2026-09-01T00:40:21,599 adding 'lm_eval/tasks/belebele/belebele_wol_Latn.yaml' 2026-09-01T00:40:21,600 adding 'lm_eval/tasks/belebele/belebele_xho_Latn.yaml' 2026-09-01T00:40:21,601 adding 'lm_eval/tasks/belebele/belebele_yor_Latn.yaml' 2026-09-01T00:40:21,602 adding 'lm_eval/tasks/belebele/belebele_zho_Hans.yaml' 2026-09-01T00:40:21,603 adding 'lm_eval/tasks/belebele/belebele_zho_Hant.yaml' 2026-09-01T00:40:21,604 adding 'lm_eval/tasks/belebele/belebele_zsm_Latn.yaml' 2026-09-01T00:40:21,606 adding 'lm_eval/tasks/belebele/belebele_zul_Latn.yaml' 2026-09-01T00:40:21,608 adding 'lm_eval/tasks/benchmarks/README.md' 2026-09-01T00:40:21,609 adding 'lm_eval/tasks/benchmarks/minerva_math.yaml' 2026-09-01T00:40:21,610 adding 'lm_eval/tasks/benchmarks/openllm.yaml' 2026-09-01T00:40:21,611 adding 'lm_eval/tasks/benchmarks/pythia.yaml' 2026-09-01T00:40:21,612 adding 'lm_eval/tasks/benchmarks/t0_eval.yaml' 2026-09-01T00:40:21,614 adding 'lm_eval/tasks/benchmarks/flan/_held_in_template_yaml' 2026-09-01T00:40:21,616 adding 'lm_eval/tasks/benchmarks/flan/flan_held_in.yaml' 2026-09-01T00:40:21,617 adding 'lm_eval/tasks/benchmarks/flan/flan_held_out.yaml' 2026-09-01T00:40:21,619 adding 'lm_eval/tasks/benchmarks/multimedqa/README.md' 2026-09-01T00:40:21,620 adding 'lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml' 2026-09-01T00:40:21,622 adding 'lm_eval/tasks/bertaqa/README.md' 2026-09-01T00:40:21,623 adding 'lm_eval/tasks/bertaqa/_bertaqa_template' 2026-09-01T00:40:21,624 adding 'lm_eval/tasks/bertaqa/bertaqa_en.yaml' 2026-09-01T00:40:21,625 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml' 2026-09-01T00:40:21,626 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml' 2026-09-01T00:40:21,628 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml' 2026-09-01T00:40:21,629 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml' 2026-09-01T00:40:21,630 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml' 2026-09-01T00:40:21,631 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml' 2026-09-01T00:40:21,632 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml' 2026-09-01T00:40:21,633 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml' 2026-09-01T00:40:21,634 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml' 2026-09-01T00:40:21,635 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml' 2026-09-01T00:40:21,637 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml' 2026-09-01T00:40:21,638 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml' 2026-09-01T00:40:21,639 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml' 2026-09-01T00:40:21,640 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml' 2026-09-01T00:40:21,641 adding 'lm_eval/tasks/bertaqa/bertaqa_eu.yaml' 2026-09-01T00:40:21,644 adding 'lm_eval/tasks/bhs/README.md' 2026-09-01T00:40:21,645 adding 'lm_eval/tasks/bhs/_template_yaml' 2026-09-01T00:40:21,646 adding 'lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml' 2026-09-01T00:40:21,647 adding 'lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml' 2026-09-01T00:40:21,649 adding 'lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml' 2026-09-01T00:40:21,650 adding 'lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml' 2026-09-01T00:40:21,651 adding 'lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml' 2026-09-01T00:40:21,652 adding 'lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml' 2026-09-01T00:40:21,653 adding 'lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml' 2026-09-01T00:40:21,654 adding 'lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml' 2026-09-01T00:40:21,656 adding 'lm_eval/tasks/bhs/bhs_basque.yaml' 2026-09-01T00:40:21,657 adding 'lm_eval/tasks/bhs/bhs_hindi.yaml' 2026-09-01T00:40:21,658 adding 'lm_eval/tasks/bhs/bhs_swahili.yaml' 2026-09-01T00:40:21,659 adding 'lm_eval/tasks/bhs/hindi-S_O_V.yaml' 2026-09-01T00:40:21,660 adding 'lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml' 2026-09-01T00:40:21,662 adding 'lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml' 2026-09-01T00:40:21,663 adding 'lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml' 2026-09-01T00:40:21,664 adding 'lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml' 2026-09-01T00:40:21,665 adding 'lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml' 2026-09-01T00:40:21,666 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml' 2026-09-01T00:40:21,667 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml' 2026-09-01T00:40:21,669 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml' 2026-09-01T00:40:21,670 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml' 2026-09-01T00:40:21,671 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml' 2026-09-01T00:40:21,672 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml' 2026-09-01T00:40:21,673 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml' 2026-09-01T00:40:21,674 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml' 2026-09-01T00:40:21,677 adding 'lm_eval/tasks/bigbench/README.md' 2026-09-01T00:40:21,679 adding 'lm_eval/tasks/bigbench/generate_tasks.py' 2026-09-01T00:40:21,680 adding 'lm_eval/tasks/bigbench/generate_until_template_yaml' 2026-09-01T00:40:21,681 adding 'lm_eval/tasks/bigbench/multiple_choice_template_a_yaml' 2026-09-01T00:40:21,682 adding 'lm_eval/tasks/bigbench/multiple_choice_template_b_yaml' 2026-09-01T00:40:21,683 adding 'lm_eval/tasks/bigbench/push_bigbench_dataset.py' 2026-09-01T00:40:21,684 adding 'lm_eval/tasks/bigbench/utils.py' 2026-09-01T00:40:21,689 adding 'lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml' 2026-09-01T00:40:21,690 adding 'lm_eval/tasks/bigbench/generate_until/anachronisms.yaml' 2026-09-01T00:40:21,691 adding 'lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml' 2026-09-01T00:40:21,693 adding 'lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml' 2026-09-01T00:40:21,694 adding 'lm_eval/tasks/bigbench/generate_until/arithmetic.yaml' 2026-09-01T00:40:21,695 adding 'lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml' 2026-09-01T00:40:21,696 adding 'lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml' 2026-09-01T00:40:21,697 adding 'lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml' 2026-09-01T00:40:21,699 adding 'lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml' 2026-09-01T00:40:21,700 adding 'lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml' 2026-09-01T00:40:21,701 adding 'lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml' 2026-09-01T00:40:21,702 adding 'lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml' 2026-09-01T00:40:21,703 adding 'lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml' 2026-09-01T00:40:21,704 adding 'lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml' 2026-09-01T00:40:21,705 adding 'lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml' 2026-09-01T00:40:21,707 adding 'lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml' 2026-09-01T00:40:21,708 adding 'lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml' 2026-09-01T00:40:21,709 adding 'lm_eval/tasks/bigbench/generate_until/code_line_description.yaml' 2026-09-01T00:40:21,710 adding 'lm_eval/tasks/bigbench/generate_until/codenames.yaml' 2026-09-01T00:40:21,711 adding 'lm_eval/tasks/bigbench/generate_until/color.yaml' 2026-09-01T00:40:21,712 adding 'lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml' 2026-09-01T00:40:21,714 adding 'lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml' 2026-09-01T00:40:21,715 adding 'lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml' 2026-09-01T00:40:21,716 adding 'lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml' 2026-09-01T00:40:21,717 adding 'lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml' 2026-09-01T00:40:21,718 adding 'lm_eval/tasks/bigbench/generate_until/crass_ai.yaml' 2026-09-01T00:40:21,720 adding 'lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml' 2026-09-01T00:40:21,721 adding 'lm_eval/tasks/bigbench/generate_until/cryptonite.yaml' 2026-09-01T00:40:21,722 adding 'lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml' 2026-09-01T00:40:21,723 adding 'lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml' 2026-09-01T00:40:21,724 adding 'lm_eval/tasks/bigbench/generate_until/date_understanding.yaml' 2026-09-01T00:40:21,726 adding 'lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml' 2026-09-01T00:40:21,727 adding 'lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml' 2026-09-01T00:40:21,728 adding 'lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml' 2026-09-01T00:40:21,729 adding 'lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml' 2026-09-01T00:40:21,730 adding 'lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml' 2026-09-01T00:40:21,731 adding 'lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml' 2026-09-01T00:40:21,732 adding 'lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml' 2026-09-01T00:40:21,733 adding 'lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml' 2026-09-01T00:40:21,735 adding 'lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml' 2026-09-01T00:40:21,736 adding 'lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml' 2026-09-01T00:40:21,737 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml' 2026-09-01T00:40:21,738 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml' 2026-09-01T00:40:21,739 adding 'lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml' 2026-09-01T00:40:21,740 adding 'lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml' 2026-09-01T00:40:21,741 adding 'lm_eval/tasks/bigbench/generate_until/fact_checker.yaml' 2026-09-01T00:40:21,742 adding 'lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml' 2026-09-01T00:40:21,743 adding 'lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml' 2026-09-01T00:40:21,745 adding 'lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml' 2026-09-01T00:40:21,746 adding 'lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml' 2026-09-01T00:40:21,747 adding 'lm_eval/tasks/bigbench/generate_until/gem.yaml' 2026-09-01T00:40:21,748 adding 'lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml' 2026-09-01T00:40:21,749 adding 'lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml' 2026-09-01T00:40:21,750 adding 'lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml' 2026-09-01T00:40:21,751 adding 'lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml' 2026-09-01T00:40:21,752 adding 'lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml' 2026-09-01T00:40:21,754 adding 'lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml' 2026-09-01T00:40:21,755 adding 'lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml' 2026-09-01T00:40:21,756 adding 'lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml' 2026-09-01T00:40:21,757 adding 'lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml' 2026-09-01T00:40:21,758 adding 'lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml' 2026-09-01T00:40:21,760 adding 'lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml' 2026-09-01T00:40:21,761 adding 'lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml' 2026-09-01T00:40:21,762 adding 'lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml' 2026-09-01T00:40:21,763 adding 'lm_eval/tasks/bigbench/generate_until/implicatures.yaml' 2026-09-01T00:40:21,764 adding 'lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml' 2026-09-01T00:40:21,766 adding 'lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml' 2026-09-01T00:40:21,767 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml' 2026-09-01T00:40:21,768 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml' 2026-09-01T00:40:21,769 adding 'lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml' 2026-09-01T00:40:21,771 adding 'lm_eval/tasks/bigbench/generate_until/irony_identification.yaml' 2026-09-01T00:40:21,772 adding 'lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml' 2026-09-01T00:40:21,773 adding 'lm_eval/tasks/bigbench/generate_until/kannada.yaml' 2026-09-01T00:40:21,774 adding 'lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml' 2026-09-01T00:40:21,775 adding 'lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml' 2026-09-01T00:40:21,777 adding 'lm_eval/tasks/bigbench/generate_until/language_games.yaml' 2026-09-01T00:40:21,778 adding 'lm_eval/tasks/bigbench/generate_until/language_identification.yaml' 2026-09-01T00:40:21,779 adding 'lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml' 2026-09-01T00:40:21,780 adding 'lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml' 2026-09-01T00:40:21,781 adding 'lm_eval/tasks/bigbench/generate_until/list_functions.yaml' 2026-09-01T00:40:21,782 adding 'lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml' 2026-09-01T00:40:21,783 adding 'lm_eval/tasks/bigbench/generate_until/logical_args.yaml' 2026-09-01T00:40:21,785 adding 'lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml' 2026-09-01T00:40:21,786 adding 'lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml' 2026-09-01T00:40:21,787 adding 'lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml' 2026-09-01T00:40:21,788 adding 'lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml' 2026-09-01T00:40:21,789 adding 'lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml' 2026-09-01T00:40:21,791 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml' 2026-09-01T00:40:21,792 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml' 2026-09-01T00:40:21,793 adding 'lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml' 2026-09-01T00:40:21,794 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions.yaml' 2026-09-01T00:40:21,796 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml' 2026-09-01T00:40:21,797 adding 'lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml' 2026-09-01T00:40:21,798 adding 'lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml' 2026-09-01T00:40:21,799 adding 'lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml' 2026-09-01T00:40:21,800 adding 'lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml' 2026-09-01T00:40:21,802 adding 'lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml' 2026-09-01T00:40:21,803 adding 'lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml' 2026-09-01T00:40:21,804 adding 'lm_eval/tasks/bigbench/generate_until/multiemo.yaml' 2026-09-01T00:40:21,805 adding 'lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml' 2026-09-01T00:40:21,806 adding 'lm_eval/tasks/bigbench/generate_until/navigate.yaml' 2026-09-01T00:40:21,807 adding 'lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml' 2026-09-01T00:40:21,809 adding 'lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml' 2026-09-01T00:40:21,810 adding 'lm_eval/tasks/bigbench/generate_until/object_counting.yaml' 2026-09-01T00:40:21,811 adding 'lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml' 2026-09-01T00:40:21,812 adding 'lm_eval/tasks/bigbench/generate_until/operators.yaml' 2026-09-01T00:40:21,813 adding 'lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml' 2026-09-01T00:40:21,814 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml' 2026-09-01T00:40:21,816 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml' 2026-09-01T00:40:21,817 adding 'lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml' 2026-09-01T00:40:21,818 adding 'lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml' 2026-09-01T00:40:21,819 adding 'lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml' 2026-09-01T00:40:21,820 adding 'lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml' 2026-09-01T00:40:21,822 adding 'lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml' 2026-09-01T00:40:21,823 adding 'lm_eval/tasks/bigbench/generate_until/physics.yaml' 2026-09-01T00:40:21,824 adding 'lm_eval/tasks/bigbench/generate_until/physics_questions.yaml' 2026-09-01T00:40:21,825 adding 'lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml' 2026-09-01T00:40:21,827 adding 'lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml' 2026-09-01T00:40:21,828 adding 'lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml' 2026-09-01T00:40:21,829 adding 'lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml' 2026-09-01T00:40:21,830 adding 'lm_eval/tasks/bigbench/generate_until/question_selection.yaml' 2026-09-01T00:40:21,831 adding 'lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml' 2026-09-01T00:40:21,832 adding 'lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml' 2026-09-01T00:40:21,833 adding 'lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml' 2026-09-01T00:40:21,834 adding 'lm_eval/tasks/bigbench/generate_until/rephrase.yaml' 2026-09-01T00:40:21,835 adding 'lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml' 2026-09-01T00:40:21,836 adding 'lm_eval/tasks/bigbench/generate_until/ruin_names.yaml' 2026-09-01T00:40:21,837 adding 'lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml' 2026-09-01T00:40:21,839 adding 'lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml' 2026-09-01T00:40:21,840 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml' 2026-09-01T00:40:21,841 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml' 2026-09-01T00:40:21,842 adding 'lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml' 2026-09-01T00:40:21,843 adding 'lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml' 2026-09-01T00:40:21,844 adding 'lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml' 2026-09-01T00:40:21,845 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml' 2026-09-01T00:40:21,847 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml' 2026-09-01T00:40:21,848 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml' 2026-09-01T00:40:21,849 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml' 2026-09-01T00:40:21,850 adding 'lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml' 2026-09-01T00:40:21,851 adding 'lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml' 2026-09-01T00:40:21,852 adding 'lm_eval/tasks/bigbench/generate_until/snarks.yaml' 2026-09-01T00:40:21,853 adding 'lm_eval/tasks/bigbench/generate_until/social_iqa.yaml' 2026-09-01T00:40:21,855 adding 'lm_eval/tasks/bigbench/generate_until/social_support.yaml' 2026-09-01T00:40:21,856 adding 'lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml' 2026-09-01T00:40:21,857 adding 'lm_eval/tasks/bigbench/generate_until/strange_stories.yaml' 2026-09-01T00:40:21,858 adding 'lm_eval/tasks/bigbench/generate_until/strategyqa.yaml' 2026-09-01T00:40:21,859 adding 'lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml' 2026-09-01T00:40:21,860 adding 'lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml' 2026-09-01T00:40:21,862 adding 'lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml' 2026-09-01T00:40:21,863 adding 'lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml' 2026-09-01T00:40:21,864 adding 'lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml' 2026-09-01T00:40:21,865 adding 'lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml' 2026-09-01T00:40:21,866 adding 'lm_eval/tasks/bigbench/generate_until/tense.yaml' 2026-09-01T00:40:21,868 adding 'lm_eval/tasks/bigbench/generate_until/timedial.yaml' 2026-09-01T00:40:21,869 adding 'lm_eval/tasks/bigbench/generate_until/topical_chat.yaml' 2026-09-01T00:40:21,870 adding 'lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml' 2026-09-01T00:40:21,871 adding 'lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml' 2026-09-01T00:40:21,872 adding 'lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml' 2026-09-01T00:40:21,873 adding 'lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml' 2026-09-01T00:40:21,875 adding 'lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml' 2026-09-01T00:40:21,876 adding 'lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml' 2026-09-01T00:40:21,877 adding 'lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml' 2026-09-01T00:40:21,878 adding 'lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml' 2026-09-01T00:40:21,879 adding 'lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml' 2026-09-01T00:40:21,880 adding 'lm_eval/tasks/bigbench/generate_until/winowhy.yaml' 2026-09-01T00:40:21,882 adding 'lm_eval/tasks/bigbench/generate_until/word_sorting.yaml' 2026-09-01T00:40:21,883 adding 'lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml' 2026-09-01T00:40:21,887 adding 'lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml' 2026-09-01T00:40:21,888 adding 'lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml' 2026-09-01T00:40:21,890 adding 'lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml' 2026-09-01T00:40:21,891 adding 'lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml' 2026-09-01T00:40:21,892 adding 'lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml' 2026-09-01T00:40:21,893 adding 'lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml' 2026-09-01T00:40:21,894 adding 'lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml' 2026-09-01T00:40:21,896 adding 'lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml' 2026-09-01T00:40:21,897 adding 'lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml' 2026-09-01T00:40:21,898 adding 'lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml' 2026-09-01T00:40:21,899 adding 'lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml' 2026-09-01T00:40:21,900 adding 'lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml' 2026-09-01T00:40:21,901 adding 'lm_eval/tasks/bigbench/multiple_choice/color.yaml' 2026-09-01T00:40:21,902 adding 'lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml' 2026-09-01T00:40:21,904 adding 'lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml' 2026-09-01T00:40:21,905 adding 'lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml' 2026-09-01T00:40:21,906 adding 'lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml' 2026-09-01T00:40:21,907 adding 'lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml' 2026-09-01T00:40:21,908 adding 'lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml' 2026-09-01T00:40:21,909 adding 'lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml' 2026-09-01T00:40:21,911 adding 'lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml' 2026-09-01T00:40:21,912 adding 'lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml' 2026-09-01T00:40:21,913 adding 'lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml' 2026-09-01T00:40:21,914 adding 'lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml' 2026-09-01T00:40:21,915 adding 'lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml' 2026-09-01T00:40:21,916 adding 'lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml' 2026-09-01T00:40:21,918 adding 'lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml' 2026-09-01T00:40:21,919 adding 'lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml' 2026-09-01T00:40:21,920 adding 'lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml' 2026-09-01T00:40:21,921 adding 'lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml' 2026-09-01T00:40:21,922 adding 'lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml' 2026-09-01T00:40:21,924 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml' 2026-09-01T00:40:21,925 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml' 2026-09-01T00:40:21,926 adding 'lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml' 2026-09-01T00:40:21,927 adding 'lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml' 2026-09-01T00:40:21,928 adding 'lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml' 2026-09-01T00:40:21,930 adding 'lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml' 2026-09-01T00:40:21,931 adding 'lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml' 2026-09-01T00:40:21,932 adding 'lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml' 2026-09-01T00:40:21,933 adding 'lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml' 2026-09-01T00:40:21,934 adding 'lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml' 2026-09-01T00:40:21,935 adding 'lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml' 2026-09-01T00:40:21,936 adding 'lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml' 2026-09-01T00:40:21,938 adding 'lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml' 2026-09-01T00:40:21,939 adding 'lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml' 2026-09-01T00:40:21,940 adding 'lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml' 2026-09-01T00:40:21,941 adding 'lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml' 2026-09-01T00:40:21,942 adding 'lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml' 2026-09-01T00:40:21,943 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml' 2026-09-01T00:40:21,944 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml' 2026-09-01T00:40:21,946 adding 'lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml' 2026-09-01T00:40:21,947 adding 'lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml' 2026-09-01T00:40:21,948 adding 'lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml' 2026-09-01T00:40:21,949 adding 'lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml' 2026-09-01T00:40:21,950 adding 'lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml' 2026-09-01T00:40:21,951 adding 'lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml' 2026-09-01T00:40:21,953 adding 'lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml' 2026-09-01T00:40:21,954 adding 'lm_eval/tasks/bigbench/multiple_choice/kannada.yaml' 2026-09-01T00:40:21,955 adding 'lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml' 2026-09-01T00:40:21,956 adding 'lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml' 2026-09-01T00:40:21,957 adding 'lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml' 2026-09-01T00:40:21,958 adding 'lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml' 2026-09-01T00:40:21,959 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml' 2026-09-01T00:40:21,960 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml' 2026-09-01T00:40:21,962 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml' 2026-09-01T00:40:21,963 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml' 2026-09-01T00:40:21,964 adding 'lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml' 2026-09-01T00:40:21,965 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml' 2026-09-01T00:40:21,966 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml' 2026-09-01T00:40:21,968 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml' 2026-09-01T00:40:21,969 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml' 2026-09-01T00:40:21,970 adding 'lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml' 2026-09-01T00:40:21,971 adding 'lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml' 2026-09-01T00:40:21,972 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml' 2026-09-01T00:40:21,973 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml' 2026-09-01T00:40:21,975 adding 'lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml' 2026-09-01T00:40:21,976 adding 'lm_eval/tasks/bigbench/multiple_choice/navigate.yaml' 2026-09-01T00:40:21,979 adding 'lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml' 2026-09-01T00:40:21,980 adding 'lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml' 2026-09-01T00:40:21,981 adding 'lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml' 2026-09-01T00:40:21,982 adding 'lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml' 2026-09-01T00:40:21,983 adding 'lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml' 2026-09-01T00:40:21,984 adding 'lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml' 2026-09-01T00:40:21,986 adding 'lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml' 2026-09-01T00:40:21,987 adding 'lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml' 2026-09-01T00:40:21,988 adding 'lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml' 2026-09-01T00:40:21,990 adding 'lm_eval/tasks/bigbench/multiple_choice/physics.yaml' 2026-09-01T00:40:21,991 adding 'lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml' 2026-09-01T00:40:21,992 adding 'lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml' 2026-09-01T00:40:21,993 adding 'lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml' 2026-09-01T00:40:21,994 adding 'lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml' 2026-09-01T00:40:21,995 adding 'lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml' 2026-09-01T00:40:21,997 adding 'lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml' 2026-09-01T00:40:21,998 adding 'lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml' 2026-09-01T00:40:21,999 adding 'lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml' 2026-09-01T00:40:22,000 adding 'lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml' 2026-09-01T00:40:22,001 adding 'lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml' 2026-09-01T00:40:22,002 adding 'lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml' 2026-09-01T00:40:22,003 adding 'lm_eval/tasks/bigbench/multiple_choice/snarks.yaml' 2026-09-01T00:40:22,005 adding 'lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml' 2026-09-01T00:40:22,006 adding 'lm_eval/tasks/bigbench/multiple_choice/social_support.yaml' 2026-09-01T00:40:22,007 adding 'lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml' 2026-09-01T00:40:22,008 adding 'lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml' 2026-09-01T00:40:22,010 adding 'lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml' 2026-09-01T00:40:22,011 adding 'lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml' 2026-09-01T00:40:22,012 adding 'lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml' 2026-09-01T00:40:22,014 adding 'lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml' 2026-09-01T00:40:22,015 adding 'lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml' 2026-09-01T00:40:22,016 adding 'lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml' 2026-09-01T00:40:22,018 adding 'lm_eval/tasks/bigbench/multiple_choice/timedial.yaml' 2026-09-01T00:40:22,019 adding 'lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml' 2026-09-01T00:40:22,020 adding 'lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml' 2026-09-01T00:40:22,021 adding 'lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml' 2026-09-01T00:40:22,022 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml' 2026-09-01T00:40:22,024 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml' 2026-09-01T00:40:22,025 adding 'lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml' 2026-09-01T00:40:22,026 adding 'lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml' 2026-09-01T00:40:22,027 adding 'lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml' 2026-09-01T00:40:22,028 adding 'lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml' 2026-09-01T00:40:22,032 adding 'lm_eval/tasks/blimp/README.md' 2026-09-01T00:40:22,033 adding 'lm_eval/tasks/blimp/_blimp.yaml' 2026-09-01T00:40:22,035 adding 'lm_eval/tasks/blimp/_template_yaml' 2026-09-01T00:40:22,036 adding 'lm_eval/tasks/blimp/adjunct_island.yaml' 2026-09-01T00:40:22,037 adding 'lm_eval/tasks/blimp/anaphor_gender_agreement.yaml' 2026-09-01T00:40:22,038 adding 'lm_eval/tasks/blimp/anaphor_number_agreement.yaml' 2026-09-01T00:40:22,039 adding 'lm_eval/tasks/blimp/animate_subject_passive.yaml' 2026-09-01T00:40:22,040 adding 'lm_eval/tasks/blimp/animate_subject_trans.yaml' 2026-09-01T00:40:22,042 adding 'lm_eval/tasks/blimp/causative.yaml' 2026-09-01T00:40:22,043 adding 'lm_eval/tasks/blimp/complex_NP_island.yaml' 2026-09-01T00:40:22,044 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml' 2026-09-01T00:40:22,045 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml' 2026-09-01T00:40:22,047 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml' 2026-09-01T00:40:22,048 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml' 2026-09-01T00:40:22,049 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml' 2026-09-01T00:40:22,051 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml' 2026-09-01T00:40:22,052 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml' 2026-09-01T00:40:22,053 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml' 2026-09-01T00:40:22,055 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml' 2026-09-01T00:40:22,056 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml' 2026-09-01T00:40:22,058 adding 'lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml' 2026-09-01T00:40:22,059 adding 'lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml' 2026-09-01T00:40:22,060 adding 'lm_eval/tasks/blimp/drop_argument.yaml' 2026-09-01T00:40:22,061 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml' 2026-09-01T00:40:22,062 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml' 2026-09-01T00:40:22,064 adding 'lm_eval/tasks/blimp/existential_there_object_raising.yaml' 2026-09-01T00:40:22,065 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml' 2026-09-01T00:40:22,066 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml' 2026-09-01T00:40:22,067 adding 'lm_eval/tasks/blimp/existential_there_subject_raising.yaml' 2026-09-01T00:40:22,068 adding 'lm_eval/tasks/blimp/expletive_it_object_raising.yaml' 2026-09-01T00:40:22,070 adding 'lm_eval/tasks/blimp/generate_configs.py' 2026-09-01T00:40:22,071 adding 'lm_eval/tasks/blimp/inchoative.yaml' 2026-09-01T00:40:22,072 adding 'lm_eval/tasks/blimp/intransitive.yaml' 2026-09-01T00:40:22,073 adding 'lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml' 2026-09-01T00:40:22,074 adding 'lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml' 2026-09-01T00:40:22,076 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml' 2026-09-01T00:40:22,077 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml' 2026-09-01T00:40:22,078 adding 'lm_eval/tasks/blimp/left_branch_island_echo_question.yaml' 2026-09-01T00:40:22,079 adding 'lm_eval/tasks/blimp/left_branch_island_simple_question.yaml' 2026-09-01T00:40:22,081 adding 'lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml' 2026-09-01T00:40:22,082 adding 'lm_eval/tasks/blimp/npi_present_1.yaml' 2026-09-01T00:40:22,083 adding 'lm_eval/tasks/blimp/npi_present_2.yaml' 2026-09-01T00:40:22,084 adding 'lm_eval/tasks/blimp/only_npi_licensor_present.yaml' 2026-09-01T00:40:22,086 adding 'lm_eval/tasks/blimp/only_npi_scope.yaml' 2026-09-01T00:40:22,087 adding 'lm_eval/tasks/blimp/passive_1.yaml' 2026-09-01T00:40:22,088 adding 'lm_eval/tasks/blimp/passive_2.yaml' 2026-09-01T00:40:22,089 adding 'lm_eval/tasks/blimp/principle_A_c_command.yaml' 2026-09-01T00:40:22,091 adding 'lm_eval/tasks/blimp/principle_A_case_1.yaml' 2026-09-01T00:40:22,092 adding 'lm_eval/tasks/blimp/principle_A_case_2.yaml' 2026-09-01T00:40:22,093 adding 'lm_eval/tasks/blimp/principle_A_domain_1.yaml' 2026-09-01T00:40:22,094 adding 'lm_eval/tasks/blimp/principle_A_domain_2.yaml' 2026-09-01T00:40:22,095 adding 'lm_eval/tasks/blimp/principle_A_domain_3.yaml' 2026-09-01T00:40:22,097 adding 'lm_eval/tasks/blimp/principle_A_reconstruction.yaml' 2026-09-01T00:40:22,098 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml' 2026-09-01T00:40:22,099 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml' 2026-09-01T00:40:22,101 adding 'lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml' 2026-09-01T00:40:22,102 adding 'lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml' 2026-09-01T00:40:22,103 adding 'lm_eval/tasks/blimp/sentential_subject_island.yaml' 2026-09-01T00:40:22,104 adding 'lm_eval/tasks/blimp/superlative_quantifiers_1.yaml' 2026-09-01T00:40:22,105 adding 'lm_eval/tasks/blimp/superlative_quantifiers_2.yaml' 2026-09-01T00:40:22,106 adding 'lm_eval/tasks/blimp/tough_vs_raising_1.yaml' 2026-09-01T00:40:22,107 adding 'lm_eval/tasks/blimp/tough_vs_raising_2.yaml' 2026-09-01T00:40:22,108 adding 'lm_eval/tasks/blimp/transitive.yaml' 2026-09-01T00:40:22,109 adding 'lm_eval/tasks/blimp/wh_island.yaml' 2026-09-01T00:40:22,111 adding 'lm_eval/tasks/blimp/wh_questions_object_gap.yaml' 2026-09-01T00:40:22,112 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap.yaml' 2026-09-01T00:40:22,113 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml' 2026-09-01T00:40:22,114 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml' 2026-09-01T00:40:22,115 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml' 2026-09-01T00:40:22,116 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml' 2026-09-01T00:40:22,117 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml' 2026-09-01T00:40:22,121 adding 'lm_eval/tasks/blimp_nl/README.md' 2026-09-01T00:40:22,122 adding 'lm_eval/tasks/blimp_nl/_template_yaml' 2026-09-01T00:40:22,123 adding 'lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml' 2026-09-01T00:40:22,125 adding 'lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml' 2026-09-01T00:40:22,126 adding 'lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml' 2026-09-01T00:40:22,127 adding 'lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml' 2026-09-01T00:40:22,128 adding 'lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml' 2026-09-01T00:40:22,129 adding 'lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml' 2026-09-01T00:40:22,130 adding 'lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml' 2026-09-01T00:40:22,132 adding 'lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml' 2026-09-01T00:40:22,133 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml' 2026-09-01T00:40:22,134 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml' 2026-09-01T00:40:22,135 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml' 2026-09-01T00:40:22,137 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml' 2026-09-01T00:40:22,138 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml' 2026-09-01T00:40:22,139 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml' 2026-09-01T00:40:22,140 adding 'lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml' 2026-09-01T00:40:22,141 adding 'lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml' 2026-09-01T00:40:22,142 adding 'lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml' 2026-09-01T00:40:22,144 adding 'lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml' 2026-09-01T00:40:22,145 adding 'lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml' 2026-09-01T00:40:22,146 adding 'lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml' 2026-09-01T00:40:22,148 adding 'lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml' 2026-09-01T00:40:22,149 adding 'lm_eval/tasks/blimp_nl/blimp_nl_group.yaml' 2026-09-01T00:40:22,150 adding 'lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml' 2026-09-01T00:40:22,151 adding 'lm_eval/tasks/blimp_nl/complementive__intransitive.yaml' 2026-09-01T00:40:22,152 adding 'lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml' 2026-09-01T00:40:22,154 adding 'lm_eval/tasks/blimp_nl/complementive__position_verb.yaml' 2026-09-01T00:40:22,155 adding 'lm_eval/tasks/blimp_nl/complementive__transitive.yaml' 2026-09-01T00:40:22,156 adding 'lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml' 2026-09-01T00:40:22,157 adding 'lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml' 2026-09-01T00:40:22,158 adding 'lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml' 2026-09-01T00:40:22,159 adding 'lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml' 2026-09-01T00:40:22,160 adding 'lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml' 2026-09-01T00:40:22,161 adding 'lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml' 2026-09-01T00:40:22,162 adding 'lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml' 2026-09-01T00:40:22,163 adding 'lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml' 2026-09-01T00:40:22,164 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml' 2026-09-01T00:40:22,165 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml' 2026-09-01T00:40:22,167 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml' 2026-09-01T00:40:22,168 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml' 2026-09-01T00:40:22,169 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml' 2026-09-01T00:40:22,170 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml' 2026-09-01T00:40:22,171 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml' 2026-09-01T00:40:22,172 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml' 2026-09-01T00:40:22,173 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml' 2026-09-01T00:40:22,175 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml' 2026-09-01T00:40:22,176 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml' 2026-09-01T00:40:22,177 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml' 2026-09-01T00:40:22,178 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml' 2026-09-01T00:40:22,179 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml' 2026-09-01T00:40:22,180 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml' 2026-09-01T00:40:22,182 adding 'lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml' 2026-09-01T00:40:22,183 adding 'lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml' 2026-09-01T00:40:22,184 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml' 2026-09-01T00:40:22,185 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml' 2026-09-01T00:40:22,186 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml' 2026-09-01T00:40:22,187 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml' 2026-09-01T00:40:22,189 adding 'lm_eval/tasks/blimp_nl/passive__aci.yaml' 2026-09-01T00:40:22,190 adding 'lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml' 2026-09-01T00:40:22,191 adding 'lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml' 2026-09-01T00:40:22,192 adding 'lm_eval/tasks/blimp_nl/passive__impersonal.yaml' 2026-09-01T00:40:22,193 adding 'lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml' 2026-09-01T00:40:22,194 adding 'lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml' 2026-09-01T00:40:22,196 adding 'lm_eval/tasks/blimp_nl/r_words__adverbial.yaml' 2026-09-01T00:40:22,197 adding 'lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml' 2026-09-01T00:40:22,198 adding 'lm_eval/tasks/blimp_nl/relativization__island.yaml' 2026-09-01T00:40:22,199 adding 'lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml' 2026-09-01T00:40:22,200 adding 'lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml' 2026-09-01T00:40:22,201 adding 'lm_eval/tasks/blimp_nl/topicalization__island.yaml' 2026-09-01T00:40:22,202 adding 'lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml' 2026-09-01T00:40:22,203 adding 'lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml' 2026-09-01T00:40:22,204 adding 'lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml' 2026-09-01T00:40:22,205 adding 'lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml' 2026-09-01T00:40:22,206 adding 'lm_eval/tasks/blimp_nl/verb_second__order_main.yaml' 2026-09-01T00:40:22,208 adding 'lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml' 2026-09-01T00:40:22,209 adding 'lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml' 2026-09-01T00:40:22,210 adding 'lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml' 2026-09-01T00:40:22,211 adding 'lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml' 2026-09-01T00:40:22,212 adding 'lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml' 2026-09-01T00:40:22,213 adding 'lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml' 2026-09-01T00:40:22,214 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml' 2026-09-01T00:40:22,215 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml' 2026-09-01T00:40:22,217 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml' 2026-09-01T00:40:22,218 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml' 2026-09-01T00:40:22,219 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml' 2026-09-01T00:40:22,220 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml' 2026-09-01T00:40:22,222 adding 'lm_eval/tasks/c4/README.md' 2026-09-01T00:40:22,223 adding 'lm_eval/tasks/c4/c4.yaml' 2026-09-01T00:40:22,224 adding 'lm_eval/tasks/c4/preprocess_c4.py' 2026-09-01T00:40:22,227 adding 'lm_eval/tasks/cabbq/README.md' 2026-09-01T00:40:22,228 adding 'lm_eval/tasks/cabbq/_cabbq_common_yaml' 2026-09-01T00:40:22,229 adding 'lm_eval/tasks/cabbq/cabbq.yaml' 2026-09-01T00:40:22,230 adding 'lm_eval/tasks/cabbq/cabbq_age.yaml' 2026-09-01T00:40:22,231 adding 'lm_eval/tasks/cabbq/cabbq_disability_status.yaml' 2026-09-01T00:40:22,233 adding 'lm_eval/tasks/cabbq/cabbq_gender.yaml' 2026-09-01T00:40:22,234 adding 'lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml' 2026-09-01T00:40:22,235 adding 'lm_eval/tasks/cabbq/cabbq_nationality.yaml' 2026-09-01T00:40:22,236 adding 'lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml' 2026-09-01T00:40:22,237 adding 'lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml' 2026-09-01T00:40:22,238 adding 'lm_eval/tasks/cabbq/cabbq_religion.yaml' 2026-09-01T00:40:22,240 adding 'lm_eval/tasks/cabbq/cabbq_ses.yaml' 2026-09-01T00:40:22,241 adding 'lm_eval/tasks/cabbq/cabbq_spanish_region.yaml' 2026-09-01T00:40:22,243 adding 'lm_eval/tasks/cabbq/utils.py' 2026-09-01T00:40:22,245 adding 'lm_eval/tasks/careqa/README.md' 2026-09-01T00:40:22,246 adding 'lm_eval/tasks/careqa/careqa_en.yaml' 2026-09-01T00:40:22,247 adding 'lm_eval/tasks/careqa/careqa_es.yaml' 2026-09-01T00:40:22,248 adding 'lm_eval/tasks/careqa/careqa_open.yaml' 2026-09-01T00:40:22,250 adding 'lm_eval/tasks/careqa/careqa_open_perplexity.yaml' 2026-09-01T00:40:22,251 adding 'lm_eval/tasks/careqa/utils.py' 2026-09-01T00:40:22,252 adding 'lm_eval/tasks/careqa/utils_open.py' 2026-09-01T00:40:22,254 adding 'lm_eval/tasks/careqa/utils_perplexity.py' 2026-09-01T00:40:22,256 adding 'lm_eval/tasks/catalan_bench/README.md' 2026-09-01T00:40:22,258 adding 'lm_eval/tasks/catalan_bench/_arc_ca_common_yaml' 2026-09-01T00:40:22,259 adding 'lm_eval/tasks/catalan_bench/_cabreu_common_yaml' 2026-09-01T00:40:22,260 adding 'lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml' 2026-09-01T00:40:22,261 adding 'lm_eval/tasks/catalan_bench/arc_ca_easy.yaml' 2026-09-01T00:40:22,262 adding 'lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml' 2026-09-01T00:40:22,263 adding 'lm_eval/tasks/catalan_bench/cabreu_extractive.yaml' 2026-09-01T00:40:22,264 adding 'lm_eval/tasks/catalan_bench/cabreu_extreme.yaml' 2026-09-01T00:40:22,265 adding 'lm_eval/tasks/catalan_bench/catalan_bench.yaml' 2026-09-01T00:40:22,266 adding 'lm_eval/tasks/catalan_bench/catalanqa.yaml' 2026-09-01T00:40:22,267 adding 'lm_eval/tasks/catalan_bench/catcola.yaml' 2026-09-01T00:40:22,269 adding 'lm_eval/tasks/catalan_bench/cocoteros_va.yaml' 2026-09-01T00:40:22,270 adding 'lm_eval/tasks/catalan_bench/copa_ca.yaml' 2026-09-01T00:40:22,271 adding 'lm_eval/tasks/catalan_bench/coqcat.yaml' 2026-09-01T00:40:22,272 adding 'lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml' 2026-09-01T00:40:22,274 adding 'lm_eval/tasks/catalan_bench/openbookqa_ca.yaml' 2026-09-01T00:40:22,275 adding 'lm_eval/tasks/catalan_bench/parafraseja.yaml' 2026-09-01T00:40:22,276 adding 'lm_eval/tasks/catalan_bench/paws_ca.yaml' 2026-09-01T00:40:22,277 adding 'lm_eval/tasks/catalan_bench/piqa_ca.yaml' 2026-09-01T00:40:22,278 adding 'lm_eval/tasks/catalan_bench/siqa_ca.yaml' 2026-09-01T00:40:22,279 adding 'lm_eval/tasks/catalan_bench/teca.yaml' 2026-09-01T00:40:22,280 adding 'lm_eval/tasks/catalan_bench/terretaqa.yaml' 2026-09-01T00:40:22,282 adding 'lm_eval/tasks/catalan_bench/utils.py' 2026-09-01T00:40:22,283 adding 'lm_eval/tasks/catalan_bench/wnli_ca.yaml' 2026-09-01T00:40:22,284 adding 'lm_eval/tasks/catalan_bench/xnli_ca.yaml' 2026-09-01T00:40:22,286 adding 'lm_eval/tasks/catalan_bench/xnli_va.yaml' 2026-09-01T00:40:22,287 adding 'lm_eval/tasks/catalan_bench/xquad_ca.yaml' 2026-09-01T00:40:22,288 adding 'lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml' 2026-09-01T00:40:22,290 adding 'lm_eval/tasks/catalan_bench/cieacova/cieacova.yaml' 2026-09-01T00:40:22,291 adding 'lm_eval/tasks/catalan_bench/cieacova/cieacova_choice.yaml' 2026-09-01T00:40:22,292 adding 'lm_eval/tasks/catalan_bench/cieacova/cieacova_word.yaml' 2026-09-01T00:40:22,294 adding 'lm_eval/tasks/catalan_bench/cieacova/utils.py' 2026-09-01T00:40:22,296 adding 'lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml' 2026-09-01T00:40:22,298 adding 'lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py' 2026-09-01T00:40:22,299 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml' 2026-09-01T00:40:22,300 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml' 2026-09-01T00:40:22,301 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml' 2026-09-01T00:40:22,302 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml' 2026-09-01T00:40:22,304 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml' 2026-09-01T00:40:22,305 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml' 2026-09-01T00:40:22,306 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml' 2026-09-01T00:40:22,307 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml' 2026-09-01T00:40:22,308 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml' 2026-09-01T00:40:22,310 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml' 2026-09-01T00:40:22,311 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml' 2026-09-01T00:40:22,312 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml' 2026-09-01T00:40:22,313 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml' 2026-09-01T00:40:22,314 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml' 2026-09-01T00:40:22,316 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml' 2026-09-01T00:40:22,317 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml' 2026-09-01T00:40:22,318 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml' 2026-09-01T00:40:22,320 adding 'lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common' 2026-09-01T00:40:22,321 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml' 2026-09-01T00:40:22,322 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml' 2026-09-01T00:40:22,323 adding 'lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml' 2026-09-01T00:40:22,325 adding 'lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py' 2026-09-01T00:40:22,329 adding 'lm_eval/tasks/ceval/README.md' 2026-09-01T00:40:22,330 adding 'lm_eval/tasks/ceval/_ceval-valid.yaml' 2026-09-01T00:40:22,331 adding 'lm_eval/tasks/ceval/_default_ceval_yaml' 2026-09-01T00:40:22,333 adding 'lm_eval/tasks/ceval/_generate_configs.py' 2026-09-01T00:40:22,334 adding 'lm_eval/tasks/ceval/ceval-valid_accountant.yaml' 2026-09-01T00:40:22,335 adding 'lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml' 2026-09-01T00:40:22,337 adding 'lm_eval/tasks/ceval/ceval-valid_art_studies.yaml' 2026-09-01T00:40:22,338 adding 'lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml' 2026-09-01T00:40:22,339 adding 'lm_eval/tasks/ceval/ceval-valid_business_administration.yaml' 2026-09-01T00:40:22,340 adding 'lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml' 2026-09-01T00:40:22,341 adding 'lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml' 2026-09-01T00:40:22,342 adding 'lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml' 2026-09-01T00:40:22,343 adding 'lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml' 2026-09-01T00:40:22,345 adding 'lm_eval/tasks/ceval/ceval-valid_college_economics.yaml' 2026-09-01T00:40:22,346 adding 'lm_eval/tasks/ceval/ceval-valid_college_physics.yaml' 2026-09-01T00:40:22,347 adding 'lm_eval/tasks/ceval/ceval-valid_college_programming.yaml' 2026-09-01T00:40:22,348 adding 'lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml' 2026-09-01T00:40:22,350 adding 'lm_eval/tasks/ceval/ceval-valid_computer_network.yaml' 2026-09-01T00:40:22,351 adding 'lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml' 2026-09-01T00:40:22,352 adding 'lm_eval/tasks/ceval/ceval-valid_education_science.yaml' 2026-09-01T00:40:22,353 adding 'lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml' 2026-09-01T00:40:22,354 adding 'lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml' 2026-09-01T00:40:22,356 adding 'lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml' 2026-09-01T00:40:22,357 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml' 2026-09-01T00:40:22,358 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml' 2026-09-01T00:40:22,359 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml' 2026-09-01T00:40:22,360 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml' 2026-09-01T00:40:22,362 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml' 2026-09-01T00:40:22,363 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml' 2026-09-01T00:40:22,364 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml' 2026-09-01T00:40:22,365 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml' 2026-09-01T00:40:22,367 adding 'lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml' 2026-09-01T00:40:22,368 adding 'lm_eval/tasks/ceval/ceval-valid_law.yaml' 2026-09-01T00:40:22,369 adding 'lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml' 2026-09-01T00:40:22,370 adding 'lm_eval/tasks/ceval/ceval-valid_logic.yaml' 2026-09-01T00:40:22,371 adding 'lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml' 2026-09-01T00:40:22,373 adding 'lm_eval/tasks/ceval/ceval-valid_marxism.yaml' 2026-09-01T00:40:22,374 adding 'lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml' 2026-09-01T00:40:22,375 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml' 2026-09-01T00:40:22,376 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml' 2026-09-01T00:40:22,378 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml' 2026-09-01T00:40:22,379 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml' 2026-09-01T00:40:22,380 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml' 2026-09-01T00:40:22,381 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml' 2026-09-01T00:40:22,382 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml' 2026-09-01T00:40:22,383 adding 'lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml' 2026-09-01T00:40:22,384 adding 'lm_eval/tasks/ceval/ceval-valid_operating_system.yaml' 2026-09-01T00:40:22,385 adding 'lm_eval/tasks/ceval/ceval-valid_physician.yaml' 2026-09-01T00:40:22,387 adding 'lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml' 2026-09-01T00:40:22,388 adding 'lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml' 2026-09-01T00:40:22,389 adding 'lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml' 2026-09-01T00:40:22,390 adding 'lm_eval/tasks/ceval/ceval-valid_sports_science.yaml' 2026-09-01T00:40:22,391 adding 'lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml' 2026-09-01T00:40:22,393 adding 'lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml' 2026-09-01T00:40:22,394 adding 'lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml' 2026-09-01T00:40:22,395 adding 'lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml' 2026-09-01T00:40:22,397 adding 'lm_eval/tasks/chartqa/README.md' 2026-09-01T00:40:22,398 adding 'lm_eval/tasks/chartqa/chartqa.yaml' 2026-09-01T00:40:22,399 adding 'lm_eval/tasks/chartqa/chartqa_llama.yaml' 2026-09-01T00:40:22,401 adding 'lm_eval/tasks/chartqa/chartqa_llama_90.yaml' 2026-09-01T00:40:22,403 adding 'lm_eval/tasks/chartqa/utils.py' 2026-09-01T00:40:22,405 adding 'lm_eval/tasks/click/README.md' 2026-09-01T00:40:22,406 adding 'lm_eval/tasks/click/click.yaml' 2026-09-01T00:40:22,408 adding 'lm_eval/tasks/click/click_cul/_click_cul.yaml' 2026-09-01T00:40:22,410 adding 'lm_eval/tasks/click/click_cul/_default_click_cul_yaml' 2026-09-01T00:40:22,411 adding 'lm_eval/tasks/click/click_cul/click_cul_economy.yaml' 2026-09-01T00:40:22,412 adding 'lm_eval/tasks/click/click_cul/click_cul_geography.yaml' 2026-09-01T00:40:22,413 adding 'lm_eval/tasks/click/click_cul/click_cul_history.yaml' 2026-09-01T00:40:22,415 adding 'lm_eval/tasks/click/click_cul/click_cul_kpop.yaml' 2026-09-01T00:40:22,416 adding 'lm_eval/tasks/click/click_cul/click_cul_law.yaml' 2026-09-01T00:40:22,417 adding 'lm_eval/tasks/click/click_cul/click_cul_politics.yaml' 2026-09-01T00:40:22,418 adding 'lm_eval/tasks/click/click_cul/click_cul_society.yaml' 2026-09-01T00:40:22,419 adding 'lm_eval/tasks/click/click_cul/click_cul_tradition.yaml' 2026-09-01T00:40:22,420 adding 'lm_eval/tasks/click/click_cul/utils.py' 2026-09-01T00:40:22,422 adding 'lm_eval/tasks/click/click_lang/_click_lang.yaml' 2026-09-01T00:40:22,423 adding 'lm_eval/tasks/click/click_lang/_default_click_lang_yaml' 2026-09-01T00:40:22,425 adding 'lm_eval/tasks/click/click_lang/click_lang_function.yaml' 2026-09-01T00:40:22,426 adding 'lm_eval/tasks/click/click_lang/click_lang_grammar.yaml' 2026-09-01T00:40:22,427 adding 'lm_eval/tasks/click/click_lang/click_lang_text.yaml' 2026-09-01T00:40:22,428 adding 'lm_eval/tasks/click/click_lang/utils.py' 2026-09-01T00:40:22,431 adding 'lm_eval/tasks/cmmlu/README.md' 2026-09-01T00:40:22,433 adding 'lm_eval/tasks/cmmlu/_cmmlu.yaml' 2026-09-01T00:40:22,434 adding 'lm_eval/tasks/cmmlu/_default_template_yaml' 2026-09-01T00:40:22,436 adding 'lm_eval/tasks/cmmlu/_generate_configs.py' 2026-09-01T00:40:22,437 adding 'lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml' 2026-09-01T00:40:22,438 adding 'lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml' 2026-09-01T00:40:22,439 adding 'lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml' 2026-09-01T00:40:22,440 adding 'lm_eval/tasks/cmmlu/cmmlu_arts.yaml' 2026-09-01T00:40:22,441 adding 'lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml' 2026-09-01T00:40:22,442 adding 'lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml' 2026-09-01T00:40:22,443 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml' 2026-09-01T00:40:22,445 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml' 2026-09-01T00:40:22,446 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml' 2026-09-01T00:40:22,447 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml' 2026-09-01T00:40:22,448 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml' 2026-09-01T00:40:22,449 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml' 2026-09-01T00:40:22,450 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml' 2026-09-01T00:40:22,451 adding 'lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml' 2026-09-01T00:40:22,452 adding 'lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml' 2026-09-01T00:40:22,453 adding 'lm_eval/tasks/cmmlu/cmmlu_college_education.yaml' 2026-09-01T00:40:22,455 adding 'lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml' 2026-09-01T00:40:22,456 adding 'lm_eval/tasks/cmmlu/cmmlu_college_law.yaml' 2026-09-01T00:40:22,457 adding 'lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml' 2026-09-01T00:40:22,458 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml' 2026-09-01T00:40:22,459 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml' 2026-09-01T00:40:22,460 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml' 2026-09-01T00:40:22,461 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml' 2026-09-01T00:40:22,463 adding 'lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml' 2026-09-01T00:40:22,464 adding 'lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml' 2026-09-01T00:40:22,465 adding 'lm_eval/tasks/cmmlu/cmmlu_economics.yaml' 2026-09-01T00:40:22,466 adding 'lm_eval/tasks/cmmlu/cmmlu_education.yaml' 2026-09-01T00:40:22,467 adding 'lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml' 2026-09-01T00:40:22,469 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml' 2026-09-01T00:40:22,470 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml' 2026-09-01T00:40:22,471 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml' 2026-09-01T00:40:22,472 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml' 2026-09-01T00:40:22,473 adding 'lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml' 2026-09-01T00:40:22,475 adding 'lm_eval/tasks/cmmlu/cmmlu_food_science.yaml' 2026-09-01T00:40:22,476 adding 'lm_eval/tasks/cmmlu/cmmlu_genetics.yaml' 2026-09-01T00:40:22,477 adding 'lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml' 2026-09-01T00:40:22,478 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml' 2026-09-01T00:40:22,480 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml' 2026-09-01T00:40:22,481 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml' 2026-09-01T00:40:22,482 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml' 2026-09-01T00:40:22,483 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml' 2026-09-01T00:40:22,484 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml' 2026-09-01T00:40:22,486 adding 'lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml' 2026-09-01T00:40:22,487 adding 'lm_eval/tasks/cmmlu/cmmlu_international_law.yaml' 2026-09-01T00:40:22,488 adding 'lm_eval/tasks/cmmlu/cmmlu_journalism.yaml' 2026-09-01T00:40:22,489 adding 'lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml' 2026-09-01T00:40:22,490 adding 'lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml' 2026-09-01T00:40:22,492 adding 'lm_eval/tasks/cmmlu/cmmlu_logical.yaml' 2026-09-01T00:40:22,493 adding 'lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml' 2026-09-01T00:40:22,494 adding 'lm_eval/tasks/cmmlu/cmmlu_management.yaml' 2026-09-01T00:40:22,495 adding 'lm_eval/tasks/cmmlu/cmmlu_marketing.yaml' 2026-09-01T00:40:22,497 adding 'lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml' 2026-09-01T00:40:22,498 adding 'lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml' 2026-09-01T00:40:22,499 adding 'lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml' 2026-09-01T00:40:22,500 adding 'lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml' 2026-09-01T00:40:22,501 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml' 2026-09-01T00:40:22,502 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml' 2026-09-01T00:40:22,503 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml' 2026-09-01T00:40:22,504 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml' 2026-09-01T00:40:22,506 adding 'lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml' 2026-09-01T00:40:22,507 adding 'lm_eval/tasks/cmmlu/cmmlu_security_study.yaml' 2026-09-01T00:40:22,508 adding 'lm_eval/tasks/cmmlu/cmmlu_sociology.yaml' 2026-09-01T00:40:22,509 adding 'lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml' 2026-09-01T00:40:22,510 adding 'lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml' 2026-09-01T00:40:22,512 adding 'lm_eval/tasks/cmmlu/cmmlu_virology.yaml' 2026-09-01T00:40:22,513 adding 'lm_eval/tasks/cmmlu/cmmlu_world_history.yaml' 2026-09-01T00:40:22,514 adding 'lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml' 2026-09-01T00:40:22,516 adding 'lm_eval/tasks/cnn_dailymail/README.md' 2026-09-01T00:40:22,517 adding 'lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml' 2026-09-01T00:40:22,519 adding 'lm_eval/tasks/cnn_dailymail/utils.py' 2026-09-01T00:40:22,521 adding 'lm_eval/tasks/code_x_glue/code-text/README.md' 2026-09-01T00:40:22,522 adding 'lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml' 2026-09-01T00:40:22,524 adding 'lm_eval/tasks/code_x_glue/code-text/_default_template_yaml' 2026-09-01T00:40:22,525 adding 'lm_eval/tasks/code_x_glue/code-text/bleu.py' 2026-09-01T00:40:22,527 adding 'lm_eval/tasks/code_x_glue/code-text/go.yaml' 2026-09-01T00:40:22,528 adding 'lm_eval/tasks/code_x_glue/code-text/java.yaml' 2026-09-01T00:40:22,529 adding 'lm_eval/tasks/code_x_glue/code-text/javascript.yaml' 2026-09-01T00:40:22,530 adding 'lm_eval/tasks/code_x_glue/code-text/php.yaml' 2026-09-01T00:40:22,531 adding 'lm_eval/tasks/code_x_glue/code-text/python.yaml' 2026-09-01T00:40:22,532 adding 'lm_eval/tasks/code_x_glue/code-text/ruby.yaml' 2026-09-01T00:40:22,534 adding 'lm_eval/tasks/code_x_glue/code-text/utils.py' 2026-09-01T00:40:22,535 adding 'lm_eval/tasks/common_voice/common_voice_en.yaml' 2026-09-01T00:40:22,537 adding 'lm_eval/tasks/common_voice/utils.py' 2026-09-01T00:40:22,538 adding 'lm_eval/tasks/commonsense_qa/README.md' 2026-09-01T00:40:22,540 adding 'lm_eval/tasks/commonsense_qa/default.yaml' 2026-09-01T00:40:22,541 adding 'lm_eval/tasks/copal_id/README.md' 2026-09-01T00:40:22,543 adding 'lm_eval/tasks/copal_id/colloquial.yaml' 2026-09-01T00:40:22,544 adding 'lm_eval/tasks/copal_id/standard.yaml' 2026-09-01T00:40:22,545 adding 'lm_eval/tasks/copal_id/utils.py' 2026-09-01T00:40:22,547 adding 'lm_eval/tasks/coqa/README.md' 2026-09-01T00:40:22,548 adding 'lm_eval/tasks/coqa/default.yaml' 2026-09-01T00:40:22,549 adding 'lm_eval/tasks/coqa/utils.py' 2026-09-01T00:40:22,552 adding 'lm_eval/tasks/crows_pairs/README.md' 2026-09-01T00:40:22,553 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english.yaml' 2026-09-01T00:40:22,554 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml' 2026-09-01T00:40:22,556 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml' 2026-09-01T00:40:22,557 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml' 2026-09-01T00:40:22,558 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml' 2026-09-01T00:40:22,559 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml' 2026-09-01T00:40:22,560 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml' 2026-09-01T00:40:22,561 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml' 2026-09-01T00:40:22,563 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml' 2026-09-01T00:40:22,564 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml' 2026-09-01T00:40:22,565 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml' 2026-09-01T00:40:22,566 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french.yaml' 2026-09-01T00:40:22,567 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml' 2026-09-01T00:40:22,568 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml' 2026-09-01T00:40:22,569 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml' 2026-09-01T00:40:22,571 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml' 2026-09-01T00:40:22,572 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml' 2026-09-01T00:40:22,573 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml' 2026-09-01T00:40:22,574 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml' 2026-09-01T00:40:22,575 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml' 2026-09-01T00:40:22,576 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml' 2026-09-01T00:40:22,577 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml' 2026-09-01T00:40:22,578 adding 'lm_eval/tasks/crows_pairs/utils.py' 2026-09-01T00:40:22,580 adding 'lm_eval/tasks/cruxeval/README.md' 2026-09-01T00:40:22,581 adding 'lm_eval/tasks/cruxeval/cruxeval_common_yaml' 2026-09-01T00:40:22,583 adding 'lm_eval/tasks/cruxeval/cruxeval_input.yaml' 2026-09-01T00:40:22,584 adding 'lm_eval/tasks/cruxeval/cruxeval_input_08.yaml' 2026-09-01T00:40:22,585 adding 'lm_eval/tasks/cruxeval/cruxeval_input_cot.yaml' 2026-09-01T00:40:22,587 adding 'lm_eval/tasks/cruxeval/cruxeval_output.yaml' 2026-09-01T00:40:22,588 adding 'lm_eval/tasks/cruxeval/cruxeval_output_08.yaml' 2026-09-01T00:40:22,589 adding 'lm_eval/tasks/cruxeval/cruxeval_output_cot.yaml' 2026-09-01T00:40:22,591 adding 'lm_eval/tasks/cruxeval/utils.py' 2026-09-01T00:40:22,593 adding 'lm_eval/tasks/csatqa/_csatqa.yaml' 2026-09-01T00:40:22,594 adding 'lm_eval/tasks/csatqa/_default_csatqa_yaml' 2026-09-01T00:40:22,596 adding 'lm_eval/tasks/csatqa/_generate_configs.py' 2026-09-01T00:40:22,597 adding 'lm_eval/tasks/csatqa/csatqa_gr.yaml' 2026-09-01T00:40:22,598 adding 'lm_eval/tasks/csatqa/csatqa_li.yaml' 2026-09-01T00:40:22,599 adding 'lm_eval/tasks/csatqa/csatqa_rch.yaml' 2026-09-01T00:40:22,600 adding 'lm_eval/tasks/csatqa/csatqa_rcs.yaml' 2026-09-01T00:40:22,602 adding 'lm_eval/tasks/csatqa/csatqa_rcss.yaml' 2026-09-01T00:40:22,603 adding 'lm_eval/tasks/csatqa/csatqa_wr.yaml' 2026-09-01T00:40:22,604 adding 'lm_eval/tasks/csatqa/utils.py' 2026-09-01T00:40:22,606 adding 'lm_eval/tasks/darija_bench/README.md' 2026-09-01T00:40:22,608 adding 'lm_eval/tasks/darija_bench/darija_sentiment/README.md' 2026-09-01T00:40:22,610 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml' 2026-09-01T00:40:22,611 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml' 2026-09-01T00:40:22,612 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml' 2026-09-01T00:40:22,613 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml' 2026-09-01T00:40:22,614 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml' 2026-09-01T00:40:22,616 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml' 2026-09-01T00:40:22,617 adding 'lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml' 2026-09-01T00:40:22,618 adding 'lm_eval/tasks/darija_bench/darija_sentiment/utils.py' 2026-09-01T00:40:22,620 adding 'lm_eval/tasks/darija_bench/darija_summarization/README.md' 2026-09-01T00:40:22,621 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml' 2026-09-01T00:40:22,623 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml' 2026-09-01T00:40:22,624 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml' 2026-09-01T00:40:22,626 adding 'lm_eval/tasks/darija_bench/darija_summarization/utils.py' 2026-09-01T00:40:22,628 adding 'lm_eval/tasks/darija_bench/darija_translation/README.md' 2026-09-01T00:40:22,629 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml' 2026-09-01T00:40:22,630 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml' 2026-09-01T00:40:22,631 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml' 2026-09-01T00:40:22,633 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml' 2026-09-01T00:40:22,634 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml' 2026-09-01T00:40:22,635 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml' 2026-09-01T00:40:22,636 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml' 2026-09-01T00:40:22,637 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml' 2026-09-01T00:40:22,639 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml' 2026-09-01T00:40:22,640 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml' 2026-09-01T00:40:22,641 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml' 2026-09-01T00:40:22,642 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml' 2026-09-01T00:40:22,643 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml' 2026-09-01T00:40:22,644 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml' 2026-09-01T00:40:22,646 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml' 2026-09-01T00:40:22,647 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml' 2026-09-01T00:40:22,648 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml' 2026-09-01T00:40:22,649 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml' 2026-09-01T00:40:22,650 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml' 2026-09-01T00:40:22,652 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml' 2026-09-01T00:40:22,653 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml' 2026-09-01T00:40:22,654 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml' 2026-09-01T00:40:22,655 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml' 2026-09-01T00:40:22,657 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml' 2026-09-01T00:40:22,658 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml' 2026-09-01T00:40:22,659 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml' 2026-09-01T00:40:22,661 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml' 2026-09-01T00:40:22,662 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml' 2026-09-01T00:40:22,663 adding 'lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml' 2026-09-01T00:40:22,664 adding 'lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml' 2026-09-01T00:40:22,666 adding 'lm_eval/tasks/darija_bench/darija_translation/utils.py' 2026-09-01T00:40:22,668 adding 'lm_eval/tasks/darija_bench/darija_transliteration/README.md' 2026-09-01T00:40:22,669 adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml' 2026-09-01T00:40:22,671 adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml' 2026-09-01T00:40:22,672 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml' 2026-09-01T00:40:22,673 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml' 2026-09-01T00:40:22,675 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml' 2026-09-01T00:40:22,676 adding 'lm_eval/tasks/darija_bench/darija_transliteration/utils.py' 2026-09-01T00:40:22,678 adding 'lm_eval/tasks/darijahellaswag/README.md' 2026-09-01T00:40:22,679 adding 'lm_eval/tasks/darijahellaswag/darijahellaswag.yaml' 2026-09-01T00:40:22,680 adding 'lm_eval/tasks/darijahellaswag/utils.py' 2026-09-01T00:40:22,683 adding 'lm_eval/tasks/darijammlu/README.md' 2026-09-01T00:40:22,684 adding 'lm_eval/tasks/darijammlu/_darijammlu.yaml' 2026-09-01T00:40:22,685 adding 'lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml' 2026-09-01T00:40:22,686 adding 'lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml' 2026-09-01T00:40:22,688 adding 'lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml' 2026-09-01T00:40:22,689 adding 'lm_eval/tasks/darijammlu/_generate_configs.py' 2026-09-01T00:40:22,690 adding 'lm_eval/tasks/darijammlu/darijammlu_accounting.yaml' 2026-09-01T00:40:22,691 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml' 2026-09-01T00:40:22,692 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml' 2026-09-01T00:40:22,694 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml' 2026-09-01T00:40:22,695 adding 'lm_eval/tasks/darijammlu/darijammlu_biology.yaml' 2026-09-01T00:40:22,696 adding 'lm_eval/tasks/darijammlu/darijammlu_civics.yaml' 2026-09-01T00:40:22,697 adding 'lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml' 2026-09-01T00:40:22,698 adding 'lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml' 2026-09-01T00:40:22,699 adding 'lm_eval/tasks/darijammlu/darijammlu_economics.yaml' 2026-09-01T00:40:22,700 adding 'lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml' 2026-09-01T00:40:22,702 adding 'lm_eval/tasks/darijammlu/darijammlu_geography.yaml' 2026-09-01T00:40:22,703 adding 'lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml' 2026-09-01T00:40:22,704 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml' 2026-09-01T00:40:22,705 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml' 2026-09-01T00:40:22,706 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:22,708 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml' 2026-09-01T00:40:22,709 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml' 2026-09-01T00:40:22,710 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml' 2026-09-01T00:40:22,711 adding 'lm_eval/tasks/darijammlu/darijammlu_history.yaml' 2026-09-01T00:40:22,712 adding 'lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml' 2026-09-01T00:40:22,713 adding 'lm_eval/tasks/darijammlu/darijammlu_international_law.yaml' 2026-09-01T00:40:22,715 adding 'lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml' 2026-09-01T00:40:22,716 adding 'lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml' 2026-09-01T00:40:22,717 adding 'lm_eval/tasks/darijammlu/darijammlu_law.yaml' 2026-09-01T00:40:22,718 adding 'lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml' 2026-09-01T00:40:22,719 adding 'lm_eval/tasks/darijammlu/darijammlu_management.yaml' 2026-09-01T00:40:22,721 adding 'lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml' 2026-09-01T00:40:22,722 adding 'lm_eval/tasks/darijammlu/darijammlu_marketing.yaml' 2026-09-01T00:40:22,723 adding 'lm_eval/tasks/darijammlu/darijammlu_math.yaml' 2026-09-01T00:40:22,724 adding 'lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml' 2026-09-01T00:40:22,725 adding 'lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml' 2026-09-01T00:40:22,727 adding 'lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml' 2026-09-01T00:40:22,728 adding 'lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml' 2026-09-01T00:40:22,729 adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml' 2026-09-01T00:40:22,730 adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml' 2026-09-01T00:40:22,731 adding 'lm_eval/tasks/darijammlu/darijammlu_physics.yaml' 2026-09-01T00:40:22,733 adding 'lm_eval/tasks/darijammlu/darijammlu_political_science.yaml' 2026-09-01T00:40:22,734 adding 'lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml' 2026-09-01T00:40:22,735 adding 'lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml' 2026-09-01T00:40:22,736 adding 'lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml' 2026-09-01T00:40:22,737 adding 'lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml' 2026-09-01T00:40:22,738 adding 'lm_eval/tasks/darijammlu/darijammlu_social_science.yaml' 2026-09-01T00:40:22,739 adding 'lm_eval/tasks/darijammlu/darijammlu_sociology.yaml' 2026-09-01T00:40:22,741 adding 'lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml' 2026-09-01T00:40:22,742 adding 'lm_eval/tasks/darijammlu/utils.py' 2026-09-01T00:40:22,744 adding 'lm_eval/tasks/discrim_eval/README.md' 2026-09-01T00:40:22,745 adding 'lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml' 2026-09-01T00:40:22,746 adding 'lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml' 2026-09-01T00:40:22,748 adding 'lm_eval/tasks/discrim_eval/utils.py' 2026-09-01T00:40:22,750 adding 'lm_eval/tasks/drop/README.md' 2026-09-01T00:40:22,751 adding 'lm_eval/tasks/drop/default.yaml' 2026-09-01T00:40:22,753 adding 'lm_eval/tasks/drop/utils.py' 2026-09-01T00:40:22,755 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/README.md' 2026-09-01T00:40:22,756 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py' 2026-09-01T00:40:22,758 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml' 2026-09-01T00:40:22,760 adding 'lm_eval/tasks/e2lmc/noor/README.md' 2026-09-01T00:40:22,761 adding 'lm_eval/tasks/e2lmc/noor/_generate_configs.py' 2026-09-01T00:40:22,763 adding 'lm_eval/tasks/e2lmc/noor/_noor.yaml' 2026-09-01T00:40:22,764 adding 'lm_eval/tasks/e2lmc/noor/_noor_stem.yaml' 2026-09-01T00:40:22,765 adding 'lm_eval/tasks/e2lmc/noor/_noor_template' 2026-09-01T00:40:22,766 adding 'lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml' 2026-09-01T00:40:22,768 adding 'lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml' 2026-09-01T00:40:22,769 adding 'lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml' 2026-09-01T00:40:22,770 adding 'lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml' 2026-09-01T00:40:22,771 adding 'lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml' 2026-09-01T00:40:22,772 adding 'lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml' 2026-09-01T00:40:22,774 adding 'lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml' 2026-09-01T00:40:22,775 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml' 2026-09-01T00:40:22,776 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml' 2026-09-01T00:40:22,777 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml' 2026-09-01T00:40:22,778 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml' 2026-09-01T00:40:22,780 adding 'lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml' 2026-09-01T00:40:22,782 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md' 2026-09-01T00:40:22,783 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml' 2026-09-01T00:40:22,784 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml' 2026-09-01T00:40:22,785 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml' 2026-09-01T00:40:22,787 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml' 2026-09-01T00:40:22,788 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml' 2026-09-01T00:40:22,789 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml' 2026-09-01T00:40:22,791 adding 'lm_eval/tasks/egyhellaswag/README.md' 2026-09-01T00:40:22,792 adding 'lm_eval/tasks/egyhellaswag/egyhellaswag.yaml' 2026-09-01T00:40:22,794 adding 'lm_eval/tasks/egyhellaswag/utils.py' 2026-09-01T00:40:22,797 adding 'lm_eval/tasks/egymmlu/README.md' 2026-09-01T00:40:22,798 adding 'lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml' 2026-09-01T00:40:22,799 adding 'lm_eval/tasks/egymmlu/_egymmlu.yaml' 2026-09-01T00:40:22,800 adding 'lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml' 2026-09-01T00:40:22,801 adding 'lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml' 2026-09-01T00:40:22,802 adding 'lm_eval/tasks/egymmlu/_generate_configs.py' 2026-09-01T00:40:22,804 adding 'lm_eval/tasks/egymmlu/egymmlu_accounting.yaml' 2026-09-01T00:40:22,805 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml' 2026-09-01T00:40:22,806 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml' 2026-09-01T00:40:22,807 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml' 2026-09-01T00:40:22,808 adding 'lm_eval/tasks/egymmlu/egymmlu_biology.yaml' 2026-09-01T00:40:22,809 adding 'lm_eval/tasks/egymmlu/egymmlu_civics.yaml' 2026-09-01T00:40:22,810 adding 'lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml' 2026-09-01T00:40:22,812 adding 'lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml' 2026-09-01T00:40:22,813 adding 'lm_eval/tasks/egymmlu/egymmlu_economics.yaml' 2026-09-01T00:40:22,814 adding 'lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml' 2026-09-01T00:40:22,815 adding 'lm_eval/tasks/egymmlu/egymmlu_geography.yaml' 2026-09-01T00:40:22,816 adding 'lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml' 2026-09-01T00:40:22,817 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml' 2026-09-01T00:40:22,818 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml' 2026-09-01T00:40:22,819 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:22,821 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml' 2026-09-01T00:40:22,822 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml' 2026-09-01T00:40:22,823 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml' 2026-09-01T00:40:22,824 adding 'lm_eval/tasks/egymmlu/egymmlu_history.yaml' 2026-09-01T00:40:22,825 adding 'lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml' 2026-09-01T00:40:22,827 adding 'lm_eval/tasks/egymmlu/egymmlu_international_law.yaml' 2026-09-01T00:40:22,828 adding 'lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml' 2026-09-01T00:40:22,829 adding 'lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml' 2026-09-01T00:40:22,830 adding 'lm_eval/tasks/egymmlu/egymmlu_law.yaml' 2026-09-01T00:40:22,831 adding 'lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml' 2026-09-01T00:40:22,832 adding 'lm_eval/tasks/egymmlu/egymmlu_management.yaml' 2026-09-01T00:40:22,834 adding 'lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml' 2026-09-01T00:40:22,835 adding 'lm_eval/tasks/egymmlu/egymmlu_marketing.yaml' 2026-09-01T00:40:22,836 adding 'lm_eval/tasks/egymmlu/egymmlu_math.yaml' 2026-09-01T00:40:22,837 adding 'lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml' 2026-09-01T00:40:22,838 adding 'lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml' 2026-09-01T00:40:22,840 adding 'lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml' 2026-09-01T00:40:22,841 adding 'lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml' 2026-09-01T00:40:22,842 adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml' 2026-09-01T00:40:22,843 adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml' 2026-09-01T00:40:22,844 adding 'lm_eval/tasks/egymmlu/egymmlu_physics.yaml' 2026-09-01T00:40:22,846 adding 'lm_eval/tasks/egymmlu/egymmlu_political_science.yaml' 2026-09-01T00:40:22,847 adding 'lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml' 2026-09-01T00:40:22,848 adding 'lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml' 2026-09-01T00:40:22,849 adding 'lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml' 2026-09-01T00:40:22,850 adding 'lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml' 2026-09-01T00:40:22,852 adding 'lm_eval/tasks/egymmlu/egymmlu_social_science.yaml' 2026-09-01T00:40:22,853 adding 'lm_eval/tasks/egymmlu/egymmlu_sociology.yaml' 2026-09-01T00:40:22,854 adding 'lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml' 2026-09-01T00:40:22,855 adding 'lm_eval/tasks/egymmlu/utils.py' 2026-09-01T00:40:22,857 adding 'lm_eval/tasks/eq_bench/README.md' 2026-09-01T00:40:22,858 adding 'lm_eval/tasks/eq_bench/default.yaml' 2026-09-01T00:40:22,860 adding 'lm_eval/tasks/eq_bench/utils.py' 2026-09-01T00:40:22,861 adding 'lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml' 2026-09-01T00:40:22,862 adding 'lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml' 2026-09-01T00:40:22,864 adding 'lm_eval/tasks/eq_bench/multilingual/utils.py' 2026-09-01T00:40:22,866 adding 'lm_eval/tasks/esbbq/README.md' 2026-09-01T00:40:22,867 adding 'lm_eval/tasks/esbbq/_esbbq_common_yaml' 2026-09-01T00:40:22,868 adding 'lm_eval/tasks/esbbq/esbbq.yaml' 2026-09-01T00:40:22,869 adding 'lm_eval/tasks/esbbq/esbbq_age.yaml' 2026-09-01T00:40:22,870 adding 'lm_eval/tasks/esbbq/esbbq_disability_status.yaml' 2026-09-01T00:40:22,872 adding 'lm_eval/tasks/esbbq/esbbq_gender.yaml' 2026-09-01T00:40:22,873 adding 'lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml' 2026-09-01T00:40:22,874 adding 'lm_eval/tasks/esbbq/esbbq_nationality.yaml' 2026-09-01T00:40:22,875 adding 'lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml' 2026-09-01T00:40:22,876 adding 'lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml' 2026-09-01T00:40:22,877 adding 'lm_eval/tasks/esbbq/esbbq_religion.yaml' 2026-09-01T00:40:22,878 adding 'lm_eval/tasks/esbbq/esbbq_ses.yaml' 2026-09-01T00:40:22,879 adding 'lm_eval/tasks/esbbq/esbbq_spanish_region.yaml' 2026-09-01T00:40:22,881 adding 'lm_eval/tasks/esbbq/utils.py' 2026-09-01T00:40:22,884 adding 'lm_eval/tasks/eus_exams/README.md' 2026-09-01T00:40:22,886 adding 'lm_eval/tasks/eus_exams/configs.py' 2026-09-01T00:40:22,887 adding 'lm_eval/tasks/eus_exams/eus_exams' 2026-09-01T00:40:22,888 adding 'lm_eval/tasks/eus_exams/eus_exams_es' 2026-09-01T00:40:22,889 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml' 2026-09-01T00:40:22,890 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml' 2026-09-01T00:40:22,891 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml' 2026-09-01T00:40:22,893 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml' 2026-09-01T00:40:22,894 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml' 2026-09-01T00:40:22,895 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml' 2026-09-01T00:40:22,896 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml' 2026-09-01T00:40:22,897 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml' 2026-09-01T00:40:22,898 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml' 2026-09-01T00:40:22,900 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml' 2026-09-01T00:40:22,901 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml' 2026-09-01T00:40:22,902 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml' 2026-09-01T00:40:22,903 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml' 2026-09-01T00:40:22,904 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml' 2026-09-01T00:40:22,906 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml' 2026-09-01T00:40:22,907 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml' 2026-09-01T00:40:22,908 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml' 2026-09-01T00:40:22,909 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml' 2026-09-01T00:40:22,910 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml' 2026-09-01T00:40:22,912 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml' 2026-09-01T00:40:22,913 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml' 2026-09-01T00:40:22,914 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml' 2026-09-01T00:40:22,915 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml' 2026-09-01T00:40:22,917 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml' 2026-09-01T00:40:22,918 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml' 2026-09-01T00:40:22,919 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml' 2026-09-01T00:40:22,920 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml' 2026-09-01T00:40:22,921 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml' 2026-09-01T00:40:22,922 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml' 2026-09-01T00:40:22,923 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml' 2026-09-01T00:40:22,924 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml' 2026-09-01T00:40:22,925 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml' 2026-09-01T00:40:22,927 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml' 2026-09-01T00:40:22,928 adding 'lm_eval/tasks/eus_exams/eus_exams_eu' 2026-09-01T00:40:22,929 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml' 2026-09-01T00:40:22,930 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml' 2026-09-01T00:40:22,931 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml' 2026-09-01T00:40:22,933 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml' 2026-09-01T00:40:22,934 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml' 2026-09-01T00:40:22,935 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml' 2026-09-01T00:40:22,936 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml' 2026-09-01T00:40:22,937 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml' 2026-09-01T00:40:22,938 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml' 2026-09-01T00:40:22,939 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml' 2026-09-01T00:40:22,941 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml' 2026-09-01T00:40:22,942 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml' 2026-09-01T00:40:22,943 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml' 2026-09-01T00:40:22,944 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml' 2026-09-01T00:40:22,945 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml' 2026-09-01T00:40:22,947 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml' 2026-09-01T00:40:22,948 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml' 2026-09-01T00:40:22,949 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml' 2026-09-01T00:40:22,950 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml' 2026-09-01T00:40:22,951 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml' 2026-09-01T00:40:22,952 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml' 2026-09-01T00:40:22,954 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml' 2026-09-01T00:40:22,955 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml' 2026-09-01T00:40:22,956 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml' 2026-09-01T00:40:22,957 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml' 2026-09-01T00:40:22,958 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml' 2026-09-01T00:40:22,960 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml' 2026-09-01T00:40:22,961 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml' 2026-09-01T00:40:22,962 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml' 2026-09-01T00:40:22,963 adding 'lm_eval/tasks/eus_exams/utils.py' 2026-09-01T00:40:22,965 adding 'lm_eval/tasks/eus_proficiency/README.md' 2026-09-01T00:40:22,966 adding 'lm_eval/tasks/eus_proficiency/eus_proficiency.yaml' 2026-09-01T00:40:22,968 adding 'lm_eval/tasks/eus_reading/README.md' 2026-09-01T00:40:22,969 adding 'lm_eval/tasks/eus_reading/eus_reading.yaml' 2026-09-01T00:40:22,971 adding 'lm_eval/tasks/eus_reading/utils.py' 2026-09-01T00:40:22,973 adding 'lm_eval/tasks/eus_trivia/README.md' 2026-09-01T00:40:22,974 adding 'lm_eval/tasks/eus_trivia/eus_trivia.yaml' 2026-09-01T00:40:22,975 adding 'lm_eval/tasks/eus_trivia/utils.py' 2026-09-01T00:40:22,980 adding 'lm_eval/tasks/evalita_llm/README.md' 2026-09-01T00:40:22,981 adding 'lm_eval/tasks/evalita_llm/_at_template_yaml' 2026-09-01T00:40:22,982 adding 'lm_eval/tasks/evalita_llm/_evalita-mp.yaml' 2026-09-01T00:40:22,983 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml' 2026-09-01T00:40:22,985 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml' 2026-09-01T00:40:22,986 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml' 2026-09-01T00:40:22,987 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml' 2026-09-01T00:40:22,988 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml' 2026-09-01T00:40:22,990 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml' 2026-09-01T00:40:22,991 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml' 2026-09-01T00:40:22,992 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml' 2026-09-01T00:40:22,993 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml' 2026-09-01T00:40:22,995 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml' 2026-09-01T00:40:22,996 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml' 2026-09-01T00:40:22,997 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml' 2026-09-01T00:40:22,998 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml' 2026-09-01T00:40:23,000 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml' 2026-09-01T00:40:23,001 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml' 2026-09-01T00:40:23,002 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml' 2026-09-01T00:40:23,003 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml' 2026-09-01T00:40:23,004 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml' 2026-09-01T00:40:23,006 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml' 2026-09-01T00:40:23,007 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml' 2026-09-01T00:40:23,008 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml' 2026-09-01T00:40:23,009 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml' 2026-09-01T00:40:23,010 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml' 2026-09-01T00:40:23,012 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml' 2026-09-01T00:40:23,013 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml' 2026-09-01T00:40:23,014 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml' 2026-09-01T00:40:23,015 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml' 2026-09-01T00:40:23,017 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml' 2026-09-01T00:40:23,018 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml' 2026-09-01T00:40:23,019 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml' 2026-09-01T00:40:23,020 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml' 2026-09-01T00:40:23,022 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml' 2026-09-01T00:40:23,023 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml' 2026-09-01T00:40:23,024 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml' 2026-09-01T00:40:23,025 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml' 2026-09-01T00:40:23,027 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg' 2026-09-01T00:40:23,028 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml' 2026-09-01T00:40:23,029 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml' 2026-09-01T00:40:23,030 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic' 2026-09-01T00:40:23,032 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml' 2026-09-01T00:40:23,033 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml' 2026-09-01T00:40:23,034 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml' 2026-09-01T00:40:23,035 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn' 2026-09-01T00:40:23,036 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml' 2026-09-01T00:40:23,038 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml' 2026-09-01T00:40:23,039 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml' 2026-09-01T00:40:23,040 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml' 2026-09-01T00:40:23,041 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml' 2026-09-01T00:40:23,042 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml' 2026-09-01T00:40:23,043 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml' 2026-09-01T00:40:23,044 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml' 2026-09-01T00:40:23,046 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml' 2026-09-01T00:40:23,047 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml' 2026-09-01T00:40:23,048 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml' 2026-09-01T00:40:23,049 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml' 2026-09-01T00:40:23,051 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml' 2026-09-01T00:40:23,052 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml' 2026-09-01T00:40:23,053 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml' 2026-09-01T00:40:23,054 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml' 2026-09-01T00:40:23,055 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml' 2026-09-01T00:40:23,057 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml' 2026-09-01T00:40:23,058 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml' 2026-09-01T00:40:23,059 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml' 2026-09-01T00:40:23,060 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml' 2026-09-01T00:40:23,061 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml' 2026-09-01T00:40:23,063 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml' 2026-09-01T00:40:23,064 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml' 2026-09-01T00:40:23,065 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml' 2026-09-01T00:40:23,066 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml' 2026-09-01T00:40:23,067 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml' 2026-09-01T00:40:23,068 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml' 2026-09-01T00:40:23,070 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml' 2026-09-01T00:40:23,071 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml' 2026-09-01T00:40:23,072 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml' 2026-09-01T00:40:23,073 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml' 2026-09-01T00:40:23,074 adding 'lm_eval/tasks/evalita_llm/_faq_template_yaml' 2026-09-01T00:40:23,076 adding 'lm_eval/tasks/evalita_llm/_hs_template_yaml' 2026-09-01T00:40:23,077 adding 'lm_eval/tasks/evalita_llm/_ls_template_yaml' 2026-09-01T00:40:23,078 adding 'lm_eval/tasks/evalita_llm/_ner_template_yaml' 2026-09-01T00:40:23,079 adding 'lm_eval/tasks/evalita_llm/_re_template_yaml' 2026-09-01T00:40:23,080 adding 'lm_eval/tasks/evalita_llm/_sa_template_v2_yaml' 2026-09-01T00:40:23,082 adding 'lm_eval/tasks/evalita_llm/_sa_template_yaml' 2026-09-01T00:40:23,083 adding 'lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml' 2026-09-01T00:40:23,084 adding 'lm_eval/tasks/evalita_llm/_sum_template_fp_yaml' 2026-09-01T00:40:23,085 adding 'lm_eval/tasks/evalita_llm/_sum_template_yaml' 2026-09-01T00:40:23,086 adding 'lm_eval/tasks/evalita_llm/_te_template_yaml' 2026-09-01T00:40:23,088 adding 'lm_eval/tasks/evalita_llm/_wic_template_yaml' 2026-09-01T00:40:23,089 adding 'lm_eval/tasks/evalita_llm/metrics.py' 2026-09-01T00:40:23,090 adding 'lm_eval/tasks/evalita_llm/sum_utils.py' 2026-09-01T00:40:23,092 adding 'lm_eval/tasks/evalita_llm/utils.py' 2026-09-01T00:40:23,095 adding 'lm_eval/tasks/fda/README.md' 2026-09-01T00:40:23,096 adding 'lm_eval/tasks/fda/fda.yaml' 2026-09-01T00:40:23,097 adding 'lm_eval/tasks/fda/task.py' 2026-09-01T00:40:23,099 adding 'lm_eval/tasks/fld/README.md' 2026-09-01T00:40:23,100 adding 'lm_eval/tasks/fld/fld_default.yaml' 2026-09-01T00:40:23,101 adding 'lm_eval/tasks/fld/fld_logical_formula_default.yaml' 2026-09-01T00:40:23,102 adding 'lm_eval/tasks/fld/fld_logical_formula_star.yaml' 2026-09-01T00:40:23,103 adding 'lm_eval/tasks/fld/fld_star.yaml' 2026-09-01T00:40:23,106 adding 'lm_eval/tasks/french_bench/README.md' 2026-09-01T00:40:23,107 adding 'lm_eval/tasks/french_bench/_default_template_yaml' 2026-09-01T00:40:23,108 adding 'lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml' 2026-09-01T00:40:23,109 adding 'lm_eval/tasks/french_bench/french_bench_boolqa.yaml' 2026-09-01T00:40:23,110 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2.yaml' 2026-09-01T00:40:23,111 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml' 2026-09-01T00:40:23,113 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml' 2026-09-01T00:40:23,114 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml' 2026-09-01T00:40:23,115 adding 'lm_eval/tasks/french_bench/french_bench_grammar.yaml' 2026-09-01T00:40:23,116 adding 'lm_eval/tasks/french_bench/french_bench_hellaswag.yaml' 2026-09-01T00:40:23,118 adding 'lm_eval/tasks/french_bench/french_bench_multifquad.yaml' 2026-09-01T00:40:23,119 adding 'lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml' 2026-09-01T00:40:23,120 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml' 2026-09-01T00:40:23,121 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml' 2026-09-01T00:40:23,122 adding 'lm_eval/tasks/french_bench/french_bench_reading_comp.yaml' 2026-09-01T00:40:23,123 adding 'lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml' 2026-09-01T00:40:23,125 adding 'lm_eval/tasks/french_bench/french_bench_trivia.yaml' 2026-09-01T00:40:23,126 adding 'lm_eval/tasks/french_bench/french_bench_vocab.yaml' 2026-09-01T00:40:23,127 adding 'lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml' 2026-09-01T00:40:23,128 adding 'lm_eval/tasks/french_bench/french_bench_xnli.yaml' 2026-09-01T00:40:23,130 adding 'lm_eval/tasks/french_bench/preprocess_wikitext.py' 2026-09-01T00:40:23,131 adding 'lm_eval/tasks/french_bench/utils.py' 2026-09-01T00:40:23,133 adding 'lm_eval/tasks/galician_bench/README.md' 2026-09-01T00:40:23,135 adding 'lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml' 2026-09-01T00:40:23,136 adding 'lm_eval/tasks/galician_bench/galcola.yaml' 2026-09-01T00:40:23,137 adding 'lm_eval/tasks/galician_bench/galician_bench.yaml' 2026-09-01T00:40:23,138 adding 'lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml' 2026-09-01T00:40:23,139 adding 'lm_eval/tasks/galician_bench/openbookqa_gl.yaml' 2026-09-01T00:40:23,140 adding 'lm_eval/tasks/galician_bench/parafrases_gl.yaml' 2026-09-01T00:40:23,142 adding 'lm_eval/tasks/galician_bench/paws_gl.yaml' 2026-09-01T00:40:23,143 adding 'lm_eval/tasks/galician_bench/summarization_gl.yaml' 2026-09-01T00:40:23,144 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml' 2026-09-01T00:40:23,146 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml' 2026-09-01T00:40:23,147 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml' 2026-09-01T00:40:23,149 adding 'lm_eval/tasks/galician_bench/utils.py' 2026-09-01T00:40:23,150 adding 'lm_eval/tasks/galician_bench/xnli_gl.yaml' 2026-09-01T00:40:23,151 adding 'lm_eval/tasks/galician_bench/xstorycloze_gl.yaml' 2026-09-01T00:40:23,153 adding 'lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml' 2026-09-01T00:40:23,155 adding 'lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py' 2026-09-01T00:40:23,156 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml' 2026-09-01T00:40:23,157 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml' 2026-09-01T00:40:23,158 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml' 2026-09-01T00:40:23,160 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml' 2026-09-01T00:40:23,161 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml' 2026-09-01T00:40:23,162 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml' 2026-09-01T00:40:23,163 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml' 2026-09-01T00:40:23,164 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml' 2026-09-01T00:40:23,165 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml' 2026-09-01T00:40:23,166 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml' 2026-09-01T00:40:23,167 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml' 2026-09-01T00:40:23,169 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml' 2026-09-01T00:40:23,170 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml' 2026-09-01T00:40:23,171 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml' 2026-09-01T00:40:23,172 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml' 2026-09-01T00:40:23,173 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml' 2026-09-01T00:40:23,175 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml' 2026-09-01T00:40:23,176 adding 'lm_eval/tasks/glianorex/README.md' 2026-09-01T00:40:23,178 adding 'lm_eval/tasks/glianorex/glianorex.yaml' 2026-09-01T00:40:23,179 adding 'lm_eval/tasks/glianorex/glianorex_en.yaml' 2026-09-01T00:40:23,180 adding 'lm_eval/tasks/glianorex/glianorex_fr.yaml' 2026-09-01T00:40:23,184 adding 'lm_eval/tasks/glianorex/preprocess_glianorex.py' 2026-09-01T00:40:23,188 adding 'lm_eval/tasks/global_mmlu/README.md' 2026-09-01T00:40:23,193 adding 'lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml' 2026-09-01T00:40:23,195 adding 'lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml' 2026-09-01T00:40:23,200 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml' 2026-09-01T00:40:23,202 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml' 2026-09-01T00:40:23,203 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml' 2026-09-01T00:40:23,205 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml' 2026-09-01T00:40:23,206 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml' 2026-09-01T00:40:23,207 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml' 2026-09-01T00:40:23,208 adding 'lm_eval/tasks/global_mmlu/default/ar/utils.py' 2026-09-01T00:40:23,210 adding 'lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml' 2026-09-01T00:40:23,211 adding 'lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml' 2026-09-01T00:40:23,213 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml' 2026-09-01T00:40:23,214 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml' 2026-09-01T00:40:23,215 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml' 2026-09-01T00:40:23,216 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml' 2026-09-01T00:40:23,218 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml' 2026-09-01T00:40:23,219 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml' 2026-09-01T00:40:23,220 adding 'lm_eval/tasks/global_mmlu/default/bn/utils.py' 2026-09-01T00:40:23,222 adding 'lm_eval/tasks/global_mmlu/default/de/_de_template_yaml' 2026-09-01T00:40:23,223 adding 'lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml' 2026-09-01T00:40:23,225 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml' 2026-09-01T00:40:23,226 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml' 2026-09-01T00:40:23,227 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml' 2026-09-01T00:40:23,228 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml' 2026-09-01T00:40:23,230 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml' 2026-09-01T00:40:23,231 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml' 2026-09-01T00:40:23,232 adding 'lm_eval/tasks/global_mmlu/default/de/utils.py' 2026-09-01T00:40:23,234 adding 'lm_eval/tasks/global_mmlu/default/en/_en_template_yaml' 2026-09-01T00:40:23,235 adding 'lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml' 2026-09-01T00:40:23,237 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml' 2026-09-01T00:40:23,238 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml' 2026-09-01T00:40:23,239 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml' 2026-09-01T00:40:23,240 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml' 2026-09-01T00:40:23,242 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml' 2026-09-01T00:40:23,243 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml' 2026-09-01T00:40:23,244 adding 'lm_eval/tasks/global_mmlu/default/en/utils.py' 2026-09-01T00:40:23,247 adding 'lm_eval/tasks/global_mmlu/default/es/_es_template_yaml' 2026-09-01T00:40:23,248 adding 'lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml' 2026-09-01T00:40:23,249 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml' 2026-09-01T00:40:23,250 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml' 2026-09-01T00:40:23,252 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml' 2026-09-01T00:40:23,253 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml' 2026-09-01T00:40:23,254 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml' 2026-09-01T00:40:23,255 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml' 2026-09-01T00:40:23,257 adding 'lm_eval/tasks/global_mmlu/default/es/utils.py' 2026-09-01T00:40:23,258 adding 'lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml' 2026-09-01T00:40:23,260 adding 'lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml' 2026-09-01T00:40:23,261 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml' 2026-09-01T00:40:23,262 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml' 2026-09-01T00:40:23,263 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml' 2026-09-01T00:40:23,265 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml' 2026-09-01T00:40:23,266 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml' 2026-09-01T00:40:23,267 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml' 2026-09-01T00:40:23,268 adding 'lm_eval/tasks/global_mmlu/default/fr/utils.py' 2026-09-01T00:40:23,270 adding 'lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml' 2026-09-01T00:40:23,271 adding 'lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml' 2026-09-01T00:40:23,273 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml' 2026-09-01T00:40:23,274 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml' 2026-09-01T00:40:23,275 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml' 2026-09-01T00:40:23,276 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml' 2026-09-01T00:40:23,278 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml' 2026-09-01T00:40:23,279 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml' 2026-09-01T00:40:23,280 adding 'lm_eval/tasks/global_mmlu/default/hi/utils.py' 2026-09-01T00:40:23,282 adding 'lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml' 2026-09-01T00:40:23,283 adding 'lm_eval/tasks/global_mmlu/default/id/_id_template_yaml' 2026-09-01T00:40:23,285 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml' 2026-09-01T00:40:23,286 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml' 2026-09-01T00:40:23,287 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml' 2026-09-01T00:40:23,288 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml' 2026-09-01T00:40:23,290 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml' 2026-09-01T00:40:23,291 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml' 2026-09-01T00:40:23,292 adding 'lm_eval/tasks/global_mmlu/default/id/utils.py' 2026-09-01T00:40:23,294 adding 'lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml' 2026-09-01T00:40:23,295 adding 'lm_eval/tasks/global_mmlu/default/it/_it_template_yaml' 2026-09-01T00:40:23,296 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml' 2026-09-01T00:40:23,297 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml' 2026-09-01T00:40:23,298 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml' 2026-09-01T00:40:23,300 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml' 2026-09-01T00:40:23,301 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml' 2026-09-01T00:40:23,302 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml' 2026-09-01T00:40:23,304 adding 'lm_eval/tasks/global_mmlu/default/it/utils.py' 2026-09-01T00:40:23,306 adding 'lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml' 2026-09-01T00:40:23,307 adding 'lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml' 2026-09-01T00:40:23,308 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml' 2026-09-01T00:40:23,309 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml' 2026-09-01T00:40:23,310 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml' 2026-09-01T00:40:23,311 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml' 2026-09-01T00:40:23,313 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml' 2026-09-01T00:40:23,314 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml' 2026-09-01T00:40:23,315 adding 'lm_eval/tasks/global_mmlu/default/ja/utils.py' 2026-09-01T00:40:23,317 adding 'lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml' 2026-09-01T00:40:23,318 adding 'lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml' 2026-09-01T00:40:23,320 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml' 2026-09-01T00:40:23,321 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml' 2026-09-01T00:40:23,322 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml' 2026-09-01T00:40:23,323 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml' 2026-09-01T00:40:23,324 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml' 2026-09-01T00:40:23,326 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml' 2026-09-01T00:40:23,327 adding 'lm_eval/tasks/global_mmlu/default/ko/utils.py' 2026-09-01T00:40:23,329 adding 'lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml' 2026-09-01T00:40:23,330 adding 'lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml' 2026-09-01T00:40:23,331 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml' 2026-09-01T00:40:23,333 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml' 2026-09-01T00:40:23,334 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml' 2026-09-01T00:40:23,335 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml' 2026-09-01T00:40:23,336 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml' 2026-09-01T00:40:23,338 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml' 2026-09-01T00:40:23,339 adding 'lm_eval/tasks/global_mmlu/default/pt/utils.py' 2026-09-01T00:40:23,341 adding 'lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml' 2026-09-01T00:40:23,342 adding 'lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml' 2026-09-01T00:40:23,343 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml' 2026-09-01T00:40:23,344 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml' 2026-09-01T00:40:23,345 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml' 2026-09-01T00:40:23,346 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml' 2026-09-01T00:40:23,348 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml' 2026-09-01T00:40:23,349 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml' 2026-09-01T00:40:23,350 adding 'lm_eval/tasks/global_mmlu/default/sw/utils.py' 2026-09-01T00:40:23,352 adding 'lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml' 2026-09-01T00:40:23,353 adding 'lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml' 2026-09-01T00:40:23,354 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml' 2026-09-01T00:40:23,356 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml' 2026-09-01T00:40:23,357 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml' 2026-09-01T00:40:23,358 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml' 2026-09-01T00:40:23,359 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml' 2026-09-01T00:40:23,360 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml' 2026-09-01T00:40:23,361 adding 'lm_eval/tasks/global_mmlu/default/yo/utils.py' 2026-09-01T00:40:23,363 adding 'lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml' 2026-09-01T00:40:23,365 adding 'lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml' 2026-09-01T00:40:23,366 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml' 2026-09-01T00:40:23,367 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml' 2026-09-01T00:40:23,368 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml' 2026-09-01T00:40:23,370 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml' 2026-09-01T00:40:23,371 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml' 2026-09-01T00:40:23,372 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml' 2026-09-01T00:40:23,373 adding 'lm_eval/tasks/global_mmlu/default/zh/utils.py' 2026-09-01T00:40:23,378 adding 'lm_eval/tasks/global_mmlu/full/am/_am_template_yaml' 2026-09-01T00:40:23,379 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml' 2026-09-01T00:40:23,380 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml' 2026-09-01T00:40:23,381 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml' 2026-09-01T00:40:23,383 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml' 2026-09-01T00:40:23,384 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml' 2026-09-01T00:40:23,385 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml' 2026-09-01T00:40:23,388 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml' 2026-09-01T00:40:23,389 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml' 2026-09-01T00:40:23,390 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml' 2026-09-01T00:40:23,392 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml' 2026-09-01T00:40:23,393 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml' 2026-09-01T00:40:23,394 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml' 2026-09-01T00:40:23,396 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml' 2026-09-01T00:40:23,397 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml' 2026-09-01T00:40:23,398 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml' 2026-09-01T00:40:23,399 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml' 2026-09-01T00:40:23,400 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml' 2026-09-01T00:40:23,402 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml' 2026-09-01T00:40:23,403 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml' 2026-09-01T00:40:23,404 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml' 2026-09-01T00:40:23,405 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml' 2026-09-01T00:40:23,406 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml' 2026-09-01T00:40:23,407 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml' 2026-09-01T00:40:23,409 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml' 2026-09-01T00:40:23,410 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml' 2026-09-01T00:40:23,411 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml' 2026-09-01T00:40:23,412 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml' 2026-09-01T00:40:23,413 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml' 2026-09-01T00:40:23,415 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml' 2026-09-01T00:40:23,416 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml' 2026-09-01T00:40:23,417 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml' 2026-09-01T00:40:23,418 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml' 2026-09-01T00:40:23,419 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml' 2026-09-01T00:40:23,421 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml' 2026-09-01T00:40:23,422 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml' 2026-09-01T00:40:23,424 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml' 2026-09-01T00:40:23,425 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml' 2026-09-01T00:40:23,426 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml' 2026-09-01T00:40:23,427 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml' 2026-09-01T00:40:23,429 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml' 2026-09-01T00:40:23,430 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml' 2026-09-01T00:40:23,431 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml' 2026-09-01T00:40:23,432 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml' 2026-09-01T00:40:23,434 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml' 2026-09-01T00:40:23,435 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml' 2026-09-01T00:40:23,437 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml' 2026-09-01T00:40:23,439 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml' 2026-09-01T00:40:23,441 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml' 2026-09-01T00:40:23,442 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml' 2026-09-01T00:40:23,443 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml' 2026-09-01T00:40:23,445 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml' 2026-09-01T00:40:23,446 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml' 2026-09-01T00:40:23,447 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml' 2026-09-01T00:40:23,448 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml' 2026-09-01T00:40:23,449 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml' 2026-09-01T00:40:23,450 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml' 2026-09-01T00:40:23,452 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml' 2026-09-01T00:40:23,453 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml' 2026-09-01T00:40:23,454 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml' 2026-09-01T00:40:23,455 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml' 2026-09-01T00:40:23,456 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml' 2026-09-01T00:40:23,458 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml' 2026-09-01T00:40:23,459 adding 'lm_eval/tasks/global_mmlu/full/am/utils.py' 2026-09-01T00:40:23,462 adding 'lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml' 2026-09-01T00:40:23,463 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml' 2026-09-01T00:40:23,464 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml' 2026-09-01T00:40:23,466 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml' 2026-09-01T00:40:23,467 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml' 2026-09-01T00:40:23,468 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml' 2026-09-01T00:40:23,469 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml' 2026-09-01T00:40:23,470 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml' 2026-09-01T00:40:23,472 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml' 2026-09-01T00:40:23,473 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml' 2026-09-01T00:40:23,474 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml' 2026-09-01T00:40:23,476 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml' 2026-09-01T00:40:23,480 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml' 2026-09-01T00:40:23,486 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml' 2026-09-01T00:40:23,490 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml' 2026-09-01T00:40:23,496 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml' 2026-09-01T00:40:23,497 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml' 2026-09-01T00:40:23,499 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml' 2026-09-01T00:40:23,500 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml' 2026-09-01T00:40:23,502 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml' 2026-09-01T00:40:23,505 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml' 2026-09-01T00:40:23,506 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml' 2026-09-01T00:40:23,508 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml' 2026-09-01T00:40:23,510 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml' 2026-09-01T00:40:23,511 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml' 2026-09-01T00:40:23,513 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml' 2026-09-01T00:40:23,514 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml' 2026-09-01T00:40:23,515 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml' 2026-09-01T00:40:23,516 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml' 2026-09-01T00:40:23,518 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml' 2026-09-01T00:40:23,519 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml' 2026-09-01T00:40:23,520 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml' 2026-09-01T00:40:23,521 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml' 2026-09-01T00:40:23,522 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml' 2026-09-01T00:40:23,524 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml' 2026-09-01T00:40:23,525 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml' 2026-09-01T00:40:23,526 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml' 2026-09-01T00:40:23,527 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml' 2026-09-01T00:40:23,529 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml' 2026-09-01T00:40:23,530 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml' 2026-09-01T00:40:23,531 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml' 2026-09-01T00:40:23,532 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml' 2026-09-01T00:40:23,533 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml' 2026-09-01T00:40:23,535 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml' 2026-09-01T00:40:23,536 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml' 2026-09-01T00:40:23,537 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml' 2026-09-01T00:40:23,538 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml' 2026-09-01T00:40:23,540 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml' 2026-09-01T00:40:23,541 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml' 2026-09-01T00:40:23,542 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml' 2026-09-01T00:40:23,543 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml' 2026-09-01T00:40:23,545 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml' 2026-09-01T00:40:23,546 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml' 2026-09-01T00:40:23,547 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml' 2026-09-01T00:40:23,548 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml' 2026-09-01T00:40:23,549 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml' 2026-09-01T00:40:23,550 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml' 2026-09-01T00:40:23,552 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml' 2026-09-01T00:40:23,553 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml' 2026-09-01T00:40:23,554 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml' 2026-09-01T00:40:23,555 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml' 2026-09-01T00:40:23,557 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml' 2026-09-01T00:40:23,558 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml' 2026-09-01T00:40:23,559 adding 'lm_eval/tasks/global_mmlu/full/ar/utils.py' 2026-09-01T00:40:23,562 adding 'lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml' 2026-09-01T00:40:23,563 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml' 2026-09-01T00:40:23,564 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml' 2026-09-01T00:40:23,566 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml' 2026-09-01T00:40:23,567 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml' 2026-09-01T00:40:23,568 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml' 2026-09-01T00:40:23,569 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml' 2026-09-01T00:40:23,570 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml' 2026-09-01T00:40:23,572 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml' 2026-09-01T00:40:23,573 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml' 2026-09-01T00:40:23,574 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml' 2026-09-01T00:40:23,575 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml' 2026-09-01T00:40:23,576 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml' 2026-09-01T00:40:23,578 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml' 2026-09-01T00:40:23,579 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml' 2026-09-01T00:40:23,580 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml' 2026-09-01T00:40:23,581 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml' 2026-09-01T00:40:23,582 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml' 2026-09-01T00:40:23,584 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml' 2026-09-01T00:40:23,585 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml' 2026-09-01T00:40:23,586 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml' 2026-09-01T00:40:23,587 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml' 2026-09-01T00:40:23,588 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml' 2026-09-01T00:40:23,590 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml' 2026-09-01T00:40:23,591 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml' 2026-09-01T00:40:23,592 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml' 2026-09-01T00:40:23,593 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml' 2026-09-01T00:40:23,594 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml' 2026-09-01T00:40:23,595 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml' 2026-09-01T00:40:23,597 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml' 2026-09-01T00:40:23,598 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml' 2026-09-01T00:40:23,599 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml' 2026-09-01T00:40:23,600 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml' 2026-09-01T00:40:23,602 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml' 2026-09-01T00:40:23,603 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml' 2026-09-01T00:40:23,604 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml' 2026-09-01T00:40:23,605 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml' 2026-09-01T00:40:23,606 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml' 2026-09-01T00:40:23,607 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml' 2026-09-01T00:40:23,608 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml' 2026-09-01T00:40:23,610 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml' 2026-09-01T00:40:23,611 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml' 2026-09-01T00:40:23,612 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml' 2026-09-01T00:40:23,613 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml' 2026-09-01T00:40:23,614 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml' 2026-09-01T00:40:23,616 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml' 2026-09-01T00:40:23,617 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml' 2026-09-01T00:40:23,618 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml' 2026-09-01T00:40:23,619 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml' 2026-09-01T00:40:23,620 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml' 2026-09-01T00:40:23,622 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml' 2026-09-01T00:40:23,623 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml' 2026-09-01T00:40:23,624 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml' 2026-09-01T00:40:23,625 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml' 2026-09-01T00:40:23,626 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml' 2026-09-01T00:40:23,628 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml' 2026-09-01T00:40:23,629 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml' 2026-09-01T00:40:23,630 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml' 2026-09-01T00:40:23,631 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml' 2026-09-01T00:40:23,632 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml' 2026-09-01T00:40:23,634 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml' 2026-09-01T00:40:23,635 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml' 2026-09-01T00:40:23,636 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml' 2026-09-01T00:40:23,637 adding 'lm_eval/tasks/global_mmlu/full/bn/utils.py' 2026-09-01T00:40:23,641 adding 'lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml' 2026-09-01T00:40:23,642 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml' 2026-09-01T00:40:23,643 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml' 2026-09-01T00:40:23,644 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml' 2026-09-01T00:40:23,646 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml' 2026-09-01T00:40:23,647 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml' 2026-09-01T00:40:23,648 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml' 2026-09-01T00:40:23,649 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml' 2026-09-01T00:40:23,650 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml' 2026-09-01T00:40:23,651 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml' 2026-09-01T00:40:23,653 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml' 2026-09-01T00:40:23,654 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml' 2026-09-01T00:40:23,655 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml' 2026-09-01T00:40:23,656 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml' 2026-09-01T00:40:23,657 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml' 2026-09-01T00:40:23,659 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml' 2026-09-01T00:40:23,660 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml' 2026-09-01T00:40:23,661 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml' 2026-09-01T00:40:23,662 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml' 2026-09-01T00:40:23,663 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml' 2026-09-01T00:40:23,664 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml' 2026-09-01T00:40:23,665 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml' 2026-09-01T00:40:23,667 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml' 2026-09-01T00:40:23,668 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml' 2026-09-01T00:40:23,669 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml' 2026-09-01T00:40:23,670 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml' 2026-09-01T00:40:23,671 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml' 2026-09-01T00:40:23,673 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml' 2026-09-01T00:40:23,674 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml' 2026-09-01T00:40:23,675 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml' 2026-09-01T00:40:23,676 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml' 2026-09-01T00:40:23,678 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml' 2026-09-01T00:40:23,679 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml' 2026-09-01T00:40:23,680 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml' 2026-09-01T00:40:23,681 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml' 2026-09-01T00:40:23,682 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml' 2026-09-01T00:40:23,683 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml' 2026-09-01T00:40:23,685 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml' 2026-09-01T00:40:23,686 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml' 2026-09-01T00:40:23,687 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml' 2026-09-01T00:40:23,688 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml' 2026-09-01T00:40:23,689 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml' 2026-09-01T00:40:23,691 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml' 2026-09-01T00:40:23,692 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml' 2026-09-01T00:40:23,693 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml' 2026-09-01T00:40:23,694 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml' 2026-09-01T00:40:23,695 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml' 2026-09-01T00:40:23,697 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml' 2026-09-01T00:40:23,698 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml' 2026-09-01T00:40:23,699 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml' 2026-09-01T00:40:23,700 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml' 2026-09-01T00:40:23,701 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml' 2026-09-01T00:40:23,702 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml' 2026-09-01T00:40:23,703 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml' 2026-09-01T00:40:23,704 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml' 2026-09-01T00:40:23,706 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml' 2026-09-01T00:40:23,707 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml' 2026-09-01T00:40:23,708 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml' 2026-09-01T00:40:23,709 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml' 2026-09-01T00:40:23,710 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml' 2026-09-01T00:40:23,712 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml' 2026-09-01T00:40:23,713 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml' 2026-09-01T00:40:23,714 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml' 2026-09-01T00:40:23,715 adding 'lm_eval/tasks/global_mmlu/full/cs/utils.py' 2026-09-01T00:40:23,718 adding 'lm_eval/tasks/global_mmlu/full/de/_de_template_yaml' 2026-09-01T00:40:23,719 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml' 2026-09-01T00:40:23,721 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml' 2026-09-01T00:40:23,722 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml' 2026-09-01T00:40:23,723 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml' 2026-09-01T00:40:23,724 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml' 2026-09-01T00:40:23,725 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml' 2026-09-01T00:40:23,726 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml' 2026-09-01T00:40:23,728 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml' 2026-09-01T00:40:23,729 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml' 2026-09-01T00:40:23,730 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml' 2026-09-01T00:40:23,731 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml' 2026-09-01T00:40:23,732 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml' 2026-09-01T00:40:23,734 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml' 2026-09-01T00:40:23,735 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml' 2026-09-01T00:40:23,737 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml' 2026-09-01T00:40:23,739 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml' 2026-09-01T00:40:23,740 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml' 2026-09-01T00:40:23,742 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml' 2026-09-01T00:40:23,743 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml' 2026-09-01T00:40:23,745 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml' 2026-09-01T00:40:23,746 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml' 2026-09-01T00:40:23,747 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml' 2026-09-01T00:40:23,749 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml' 2026-09-01T00:40:23,750 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml' 2026-09-01T00:40:23,752 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml' 2026-09-01T00:40:23,753 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml' 2026-09-01T00:40:23,755 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml' 2026-09-01T00:40:23,756 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml' 2026-09-01T00:40:23,757 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml' 2026-09-01T00:40:23,758 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml' 2026-09-01T00:40:23,759 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml' 2026-09-01T00:40:23,761 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml' 2026-09-01T00:40:23,762 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml' 2026-09-01T00:40:23,763 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml' 2026-09-01T00:40:23,764 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml' 2026-09-01T00:40:23,765 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml' 2026-09-01T00:40:23,767 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml' 2026-09-01T00:40:23,768 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml' 2026-09-01T00:40:23,769 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml' 2026-09-01T00:40:23,770 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml' 2026-09-01T00:40:23,771 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml' 2026-09-01T00:40:23,772 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml' 2026-09-01T00:40:23,773 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml' 2026-09-01T00:40:23,775 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml' 2026-09-01T00:40:23,776 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml' 2026-09-01T00:40:23,777 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml' 2026-09-01T00:40:23,778 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml' 2026-09-01T00:40:23,779 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml' 2026-09-01T00:40:23,780 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml' 2026-09-01T00:40:23,782 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml' 2026-09-01T00:40:23,783 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml' 2026-09-01T00:40:23,784 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml' 2026-09-01T00:40:23,785 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml' 2026-09-01T00:40:23,786 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml' 2026-09-01T00:40:23,787 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml' 2026-09-01T00:40:23,788 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml' 2026-09-01T00:40:23,789 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml' 2026-09-01T00:40:23,791 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml' 2026-09-01T00:40:23,792 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml' 2026-09-01T00:40:23,793 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml' 2026-09-01T00:40:23,794 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml' 2026-09-01T00:40:23,795 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml' 2026-09-01T00:40:23,796 adding 'lm_eval/tasks/global_mmlu/full/de/utils.py' 2026-09-01T00:40:23,799 adding 'lm_eval/tasks/global_mmlu/full/el/_el_template_yaml' 2026-09-01T00:40:23,800 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml' 2026-09-01T00:40:23,801 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml' 2026-09-01T00:40:23,802 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml' 2026-09-01T00:40:23,803 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml' 2026-09-01T00:40:23,805 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml' 2026-09-01T00:40:23,806 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml' 2026-09-01T00:40:23,807 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml' 2026-09-01T00:40:23,808 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml' 2026-09-01T00:40:23,809 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml' 2026-09-01T00:40:23,810 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml' 2026-09-01T00:40:23,811 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml' 2026-09-01T00:40:23,813 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml' 2026-09-01T00:40:23,814 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml' 2026-09-01T00:40:23,815 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml' 2026-09-01T00:40:23,816 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml' 2026-09-01T00:40:23,817 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml' 2026-09-01T00:40:23,818 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml' 2026-09-01T00:40:23,820 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml' 2026-09-01T00:40:23,821 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml' 2026-09-01T00:40:23,822 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml' 2026-09-01T00:40:23,823 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml' 2026-09-01T00:40:23,825 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml' 2026-09-01T00:40:23,826 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml' 2026-09-01T00:40:23,827 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml' 2026-09-01T00:40:23,828 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml' 2026-09-01T00:40:23,829 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml' 2026-09-01T00:40:23,831 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml' 2026-09-01T00:40:23,832 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml' 2026-09-01T00:40:23,833 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml' 2026-09-01T00:40:23,834 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml' 2026-09-01T00:40:23,835 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml' 2026-09-01T00:40:23,836 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml' 2026-09-01T00:40:23,837 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml' 2026-09-01T00:40:23,838 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml' 2026-09-01T00:40:23,839 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml' 2026-09-01T00:40:23,840 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml' 2026-09-01T00:40:23,841 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml' 2026-09-01T00:40:23,843 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml' 2026-09-01T00:40:23,844 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml' 2026-09-01T00:40:23,845 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml' 2026-09-01T00:40:23,846 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml' 2026-09-01T00:40:23,847 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml' 2026-09-01T00:40:23,848 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml' 2026-09-01T00:40:23,849 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml' 2026-09-01T00:40:23,851 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml' 2026-09-01T00:40:23,852 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml' 2026-09-01T00:40:23,853 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml' 2026-09-01T00:40:23,854 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml' 2026-09-01T00:40:23,855 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml' 2026-09-01T00:40:23,856 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml' 2026-09-01T00:40:23,857 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml' 2026-09-01T00:40:23,859 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml' 2026-09-01T00:40:23,860 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml' 2026-09-01T00:40:23,861 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml' 2026-09-01T00:40:23,862 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml' 2026-09-01T00:40:23,863 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml' 2026-09-01T00:40:23,864 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml' 2026-09-01T00:40:23,866 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml' 2026-09-01T00:40:23,867 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml' 2026-09-01T00:40:23,868 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml' 2026-09-01T00:40:23,869 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml' 2026-09-01T00:40:23,870 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml' 2026-09-01T00:40:23,871 adding 'lm_eval/tasks/global_mmlu/full/el/utils.py' 2026-09-01T00:40:23,874 adding 'lm_eval/tasks/global_mmlu/full/en/_en_template_yaml' 2026-09-01T00:40:23,875 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml' 2026-09-01T00:40:23,876 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml' 2026-09-01T00:40:23,878 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml' 2026-09-01T00:40:23,879 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml' 2026-09-01T00:40:23,880 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml' 2026-09-01T00:40:23,881 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml' 2026-09-01T00:40:23,882 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml' 2026-09-01T00:40:23,883 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml' 2026-09-01T00:40:23,884 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml' 2026-09-01T00:40:23,885 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml' 2026-09-01T00:40:23,886 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml' 2026-09-01T00:40:23,888 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml' 2026-09-01T00:40:23,889 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml' 2026-09-01T00:40:23,890 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml' 2026-09-01T00:40:23,891 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml' 2026-09-01T00:40:23,892 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml' 2026-09-01T00:40:23,893 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml' 2026-09-01T00:40:23,894 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml' 2026-09-01T00:40:23,895 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml' 2026-09-01T00:40:23,897 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml' 2026-09-01T00:40:23,898 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml' 2026-09-01T00:40:23,899 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml' 2026-09-01T00:40:23,900 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml' 2026-09-01T00:40:23,901 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml' 2026-09-01T00:40:23,902 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml' 2026-09-01T00:40:23,903 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml' 2026-09-01T00:40:23,905 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml' 2026-09-01T00:40:23,906 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml' 2026-09-01T00:40:23,907 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml' 2026-09-01T00:40:23,908 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml' 2026-09-01T00:40:23,909 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml' 2026-09-01T00:40:23,911 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml' 2026-09-01T00:40:23,912 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml' 2026-09-01T00:40:23,913 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml' 2026-09-01T00:40:23,914 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml' 2026-09-01T00:40:23,916 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml' 2026-09-01T00:40:23,917 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml' 2026-09-01T00:40:23,918 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml' 2026-09-01T00:40:23,919 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml' 2026-09-01T00:40:23,920 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml' 2026-09-01T00:40:23,921 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml' 2026-09-01T00:40:23,922 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml' 2026-09-01T00:40:23,924 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml' 2026-09-01T00:40:23,925 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml' 2026-09-01T00:40:23,926 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml' 2026-09-01T00:40:23,927 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml' 2026-09-01T00:40:23,928 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml' 2026-09-01T00:40:23,931 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml' 2026-09-01T00:40:23,933 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml' 2026-09-01T00:40:23,934 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml' 2026-09-01T00:40:23,935 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml' 2026-09-01T00:40:23,936 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml' 2026-09-01T00:40:23,938 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml' 2026-09-01T00:40:23,939 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml' 2026-09-01T00:40:23,940 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml' 2026-09-01T00:40:23,941 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml' 2026-09-01T00:40:23,942 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml' 2026-09-01T00:40:23,944 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml' 2026-09-01T00:40:23,945 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml' 2026-09-01T00:40:23,946 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml' 2026-09-01T00:40:23,947 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml' 2026-09-01T00:40:23,948 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml' 2026-09-01T00:40:23,950 adding 'lm_eval/tasks/global_mmlu/full/en/utils.py' 2026-09-01T00:40:23,953 adding 'lm_eval/tasks/global_mmlu/full/es/_es_template_yaml' 2026-09-01T00:40:23,954 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml' 2026-09-01T00:40:23,955 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml' 2026-09-01T00:40:23,956 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml' 2026-09-01T00:40:23,958 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml' 2026-09-01T00:40:23,959 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml' 2026-09-01T00:40:23,960 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml' 2026-09-01T00:40:23,961 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml' 2026-09-01T00:40:23,962 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml' 2026-09-01T00:40:23,964 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml' 2026-09-01T00:40:23,965 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml' 2026-09-01T00:40:23,966 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml' 2026-09-01T00:40:23,968 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml' 2026-09-01T00:40:23,969 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml' 2026-09-01T00:40:23,970 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml' 2026-09-01T00:40:23,971 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml' 2026-09-01T00:40:23,972 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml' 2026-09-01T00:40:23,973 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml' 2026-09-01T00:40:23,974 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml' 2026-09-01T00:40:23,975 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml' 2026-09-01T00:40:23,977 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml' 2026-09-01T00:40:23,978 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml' 2026-09-01T00:40:23,979 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml' 2026-09-01T00:40:23,980 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml' 2026-09-01T00:40:23,981 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml' 2026-09-01T00:40:23,983 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml' 2026-09-01T00:40:23,984 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml' 2026-09-01T00:40:23,985 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml' 2026-09-01T00:40:23,986 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml' 2026-09-01T00:40:23,987 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml' 2026-09-01T00:40:23,989 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml' 2026-09-01T00:40:23,990 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml' 2026-09-01T00:40:23,991 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml' 2026-09-01T00:40:23,992 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml' 2026-09-01T00:40:23,993 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml' 2026-09-01T00:40:23,994 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml' 2026-09-01T00:40:23,996 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml' 2026-09-01T00:40:23,997 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml' 2026-09-01T00:40:23,998 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml' 2026-09-01T00:40:24,000 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml' 2026-09-01T00:40:24,001 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml' 2026-09-01T00:40:24,002 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml' 2026-09-01T00:40:24,003 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml' 2026-09-01T00:40:24,005 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml' 2026-09-01T00:40:24,006 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml' 2026-09-01T00:40:24,007 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml' 2026-09-01T00:40:24,008 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml' 2026-09-01T00:40:24,009 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml' 2026-09-01T00:40:24,011 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml' 2026-09-01T00:40:24,012 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml' 2026-09-01T00:40:24,013 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml' 2026-09-01T00:40:24,014 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml' 2026-09-01T00:40:24,015 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml' 2026-09-01T00:40:24,017 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml' 2026-09-01T00:40:24,018 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml' 2026-09-01T00:40:24,019 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml' 2026-09-01T00:40:24,020 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml' 2026-09-01T00:40:24,021 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml' 2026-09-01T00:40:24,022 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml' 2026-09-01T00:40:24,024 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml' 2026-09-01T00:40:24,025 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml' 2026-09-01T00:40:24,026 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml' 2026-09-01T00:40:24,027 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml' 2026-09-01T00:40:24,029 adding 'lm_eval/tasks/global_mmlu/full/es/utils.py' 2026-09-01T00:40:24,032 adding 'lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml' 2026-09-01T00:40:24,033 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml' 2026-09-01T00:40:24,034 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml' 2026-09-01T00:40:24,035 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml' 2026-09-01T00:40:24,037 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml' 2026-09-01T00:40:24,038 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml' 2026-09-01T00:40:24,039 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml' 2026-09-01T00:40:24,040 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml' 2026-09-01T00:40:24,041 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml' 2026-09-01T00:40:24,043 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml' 2026-09-01T00:40:24,044 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml' 2026-09-01T00:40:24,045 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml' 2026-09-01T00:40:24,046 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml' 2026-09-01T00:40:24,047 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml' 2026-09-01T00:40:24,049 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml' 2026-09-01T00:40:24,050 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml' 2026-09-01T00:40:24,051 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml' 2026-09-01T00:40:24,052 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml' 2026-09-01T00:40:24,053 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml' 2026-09-01T00:40:24,055 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml' 2026-09-01T00:40:24,056 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml' 2026-09-01T00:40:24,057 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml' 2026-09-01T00:40:24,058 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml' 2026-09-01T00:40:24,059 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml' 2026-09-01T00:40:24,060 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml' 2026-09-01T00:40:24,061 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml' 2026-09-01T00:40:24,063 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml' 2026-09-01T00:40:24,064 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml' 2026-09-01T00:40:24,065 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml' 2026-09-01T00:40:24,066 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,067 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,068 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml' 2026-09-01T00:40:24,070 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml' 2026-09-01T00:40:24,071 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml' 2026-09-01T00:40:24,072 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml' 2026-09-01T00:40:24,073 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml' 2026-09-01T00:40:24,074 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml' 2026-09-01T00:40:24,075 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml' 2026-09-01T00:40:24,076 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml' 2026-09-01T00:40:24,078 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml' 2026-09-01T00:40:24,079 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml' 2026-09-01T00:40:24,080 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml' 2026-09-01T00:40:24,081 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml' 2026-09-01T00:40:24,082 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml' 2026-09-01T00:40:24,084 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml' 2026-09-01T00:40:24,085 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml' 2026-09-01T00:40:24,086 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml' 2026-09-01T00:40:24,087 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml' 2026-09-01T00:40:24,088 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml' 2026-09-01T00:40:24,089 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml' 2026-09-01T00:40:24,091 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml' 2026-09-01T00:40:24,092 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml' 2026-09-01T00:40:24,093 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml' 2026-09-01T00:40:24,094 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml' 2026-09-01T00:40:24,095 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml' 2026-09-01T00:40:24,097 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml' 2026-09-01T00:40:24,098 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml' 2026-09-01T00:40:24,099 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml' 2026-09-01T00:40:24,100 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml' 2026-09-01T00:40:24,103 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml' 2026-09-01T00:40:24,104 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml' 2026-09-01T00:40:24,106 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml' 2026-09-01T00:40:24,107 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml' 2026-09-01T00:40:24,108 adding 'lm_eval/tasks/global_mmlu/full/fa/utils.py' 2026-09-01T00:40:24,111 adding 'lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml' 2026-09-01T00:40:24,112 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml' 2026-09-01T00:40:24,113 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml' 2026-09-01T00:40:24,114 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml' 2026-09-01T00:40:24,116 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml' 2026-09-01T00:40:24,117 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml' 2026-09-01T00:40:24,118 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml' 2026-09-01T00:40:24,119 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml' 2026-09-01T00:40:24,120 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml' 2026-09-01T00:40:24,122 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml' 2026-09-01T00:40:24,123 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml' 2026-09-01T00:40:24,124 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml' 2026-09-01T00:40:24,125 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml' 2026-09-01T00:40:24,126 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml' 2026-09-01T00:40:24,127 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml' 2026-09-01T00:40:24,129 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml' 2026-09-01T00:40:24,130 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml' 2026-09-01T00:40:24,131 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml' 2026-09-01T00:40:24,132 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml' 2026-09-01T00:40:24,133 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml' 2026-09-01T00:40:24,135 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml' 2026-09-01T00:40:24,136 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml' 2026-09-01T00:40:24,137 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml' 2026-09-01T00:40:24,138 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml' 2026-09-01T00:40:24,140 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml' 2026-09-01T00:40:24,141 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml' 2026-09-01T00:40:24,142 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml' 2026-09-01T00:40:24,143 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml' 2026-09-01T00:40:24,144 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml' 2026-09-01T00:40:24,146 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,147 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,148 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml' 2026-09-01T00:40:24,149 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml' 2026-09-01T00:40:24,150 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml' 2026-09-01T00:40:24,151 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml' 2026-09-01T00:40:24,152 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml' 2026-09-01T00:40:24,154 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml' 2026-09-01T00:40:24,155 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml' 2026-09-01T00:40:24,156 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml' 2026-09-01T00:40:24,157 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml' 2026-09-01T00:40:24,158 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml' 2026-09-01T00:40:24,159 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml' 2026-09-01T00:40:24,160 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml' 2026-09-01T00:40:24,162 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml' 2026-09-01T00:40:24,163 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml' 2026-09-01T00:40:24,164 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml' 2026-09-01T00:40:24,165 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml' 2026-09-01T00:40:24,166 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml' 2026-09-01T00:40:24,167 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml' 2026-09-01T00:40:24,169 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml' 2026-09-01T00:40:24,170 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml' 2026-09-01T00:40:24,171 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml' 2026-09-01T00:40:24,172 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml' 2026-09-01T00:40:24,173 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml' 2026-09-01T00:40:24,174 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml' 2026-09-01T00:40:24,176 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml' 2026-09-01T00:40:24,177 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml' 2026-09-01T00:40:24,178 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml' 2026-09-01T00:40:24,179 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml' 2026-09-01T00:40:24,181 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml' 2026-09-01T00:40:24,182 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml' 2026-09-01T00:40:24,183 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml' 2026-09-01T00:40:24,184 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml' 2026-09-01T00:40:24,185 adding 'lm_eval/tasks/global_mmlu/full/fil/utils.py' 2026-09-01T00:40:24,189 adding 'lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml' 2026-09-01T00:40:24,190 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml' 2026-09-01T00:40:24,191 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml' 2026-09-01T00:40:24,192 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml' 2026-09-01T00:40:24,193 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml' 2026-09-01T00:40:24,195 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml' 2026-09-01T00:40:24,196 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml' 2026-09-01T00:40:24,197 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml' 2026-09-01T00:40:24,198 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml' 2026-09-01T00:40:24,199 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml' 2026-09-01T00:40:24,200 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml' 2026-09-01T00:40:24,201 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml' 2026-09-01T00:40:24,202 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml' 2026-09-01T00:40:24,204 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml' 2026-09-01T00:40:24,205 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml' 2026-09-01T00:40:24,206 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml' 2026-09-01T00:40:24,207 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml' 2026-09-01T00:40:24,209 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml' 2026-09-01T00:40:24,210 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml' 2026-09-01T00:40:24,211 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml' 2026-09-01T00:40:24,212 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml' 2026-09-01T00:40:24,214 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml' 2026-09-01T00:40:24,215 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml' 2026-09-01T00:40:24,216 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml' 2026-09-01T00:40:24,217 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml' 2026-09-01T00:40:24,218 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml' 2026-09-01T00:40:24,220 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml' 2026-09-01T00:40:24,221 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml' 2026-09-01T00:40:24,222 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml' 2026-09-01T00:40:24,223 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,224 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,226 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml' 2026-09-01T00:40:24,227 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml' 2026-09-01T00:40:24,228 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml' 2026-09-01T00:40:24,229 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml' 2026-09-01T00:40:24,230 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml' 2026-09-01T00:40:24,232 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml' 2026-09-01T00:40:24,233 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml' 2026-09-01T00:40:24,234 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml' 2026-09-01T00:40:24,235 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml' 2026-09-01T00:40:24,237 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml' 2026-09-01T00:40:24,238 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml' 2026-09-01T00:40:24,239 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml' 2026-09-01T00:40:24,240 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml' 2026-09-01T00:40:24,241 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml' 2026-09-01T00:40:24,242 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml' 2026-09-01T00:40:24,243 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml' 2026-09-01T00:40:24,244 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml' 2026-09-01T00:40:24,245 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml' 2026-09-01T00:40:24,247 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml' 2026-09-01T00:40:24,248 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml' 2026-09-01T00:40:24,249 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml' 2026-09-01T00:40:24,250 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml' 2026-09-01T00:40:24,251 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml' 2026-09-01T00:40:24,252 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml' 2026-09-01T00:40:24,254 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml' 2026-09-01T00:40:24,255 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml' 2026-09-01T00:40:24,256 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml' 2026-09-01T00:40:24,257 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml' 2026-09-01T00:40:24,258 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml' 2026-09-01T00:40:24,259 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml' 2026-09-01T00:40:24,261 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml' 2026-09-01T00:40:24,262 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml' 2026-09-01T00:40:24,263 adding 'lm_eval/tasks/global_mmlu/full/fr/utils.py' 2026-09-01T00:40:24,266 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml' 2026-09-01T00:40:24,267 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml' 2026-09-01T00:40:24,268 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml' 2026-09-01T00:40:24,270 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml' 2026-09-01T00:40:24,271 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml' 2026-09-01T00:40:24,272 adding 'lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml' 2026-09-01T00:40:24,273 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml' 2026-09-01T00:40:24,275 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml' 2026-09-01T00:40:24,276 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml' 2026-09-01T00:40:24,277 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml' 2026-09-01T00:40:24,279 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml' 2026-09-01T00:40:24,280 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml' 2026-09-01T00:40:24,281 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml' 2026-09-01T00:40:24,283 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml' 2026-09-01T00:40:24,284 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml' 2026-09-01T00:40:24,285 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml' 2026-09-01T00:40:24,286 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml' 2026-09-01T00:40:24,287 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml' 2026-09-01T00:40:24,288 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml' 2026-09-01T00:40:24,289 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml' 2026-09-01T00:40:24,290 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml' 2026-09-01T00:40:24,292 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml' 2026-09-01T00:40:24,293 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml' 2026-09-01T00:40:24,294 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml' 2026-09-01T00:40:24,295 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml' 2026-09-01T00:40:24,297 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml' 2026-09-01T00:40:24,298 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml' 2026-09-01T00:40:24,299 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml' 2026-09-01T00:40:24,300 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml' 2026-09-01T00:40:24,301 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,302 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,303 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml' 2026-09-01T00:40:24,305 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml' 2026-09-01T00:40:24,306 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml' 2026-09-01T00:40:24,307 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml' 2026-09-01T00:40:24,308 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml' 2026-09-01T00:40:24,309 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml' 2026-09-01T00:40:24,310 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml' 2026-09-01T00:40:24,312 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml' 2026-09-01T00:40:24,313 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml' 2026-09-01T00:40:24,314 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml' 2026-09-01T00:40:24,315 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml' 2026-09-01T00:40:24,316 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml' 2026-09-01T00:40:24,318 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml' 2026-09-01T00:40:24,319 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml' 2026-09-01T00:40:24,320 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml' 2026-09-01T00:40:24,321 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml' 2026-09-01T00:40:24,322 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml' 2026-09-01T00:40:24,323 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml' 2026-09-01T00:40:24,325 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml' 2026-09-01T00:40:24,326 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml' 2026-09-01T00:40:24,327 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml' 2026-09-01T00:40:24,328 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml' 2026-09-01T00:40:24,329 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml' 2026-09-01T00:40:24,330 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml' 2026-09-01T00:40:24,331 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml' 2026-09-01T00:40:24,333 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml' 2026-09-01T00:40:24,334 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml' 2026-09-01T00:40:24,335 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml' 2026-09-01T00:40:24,336 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml' 2026-09-01T00:40:24,337 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml' 2026-09-01T00:40:24,338 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml' 2026-09-01T00:40:24,340 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml' 2026-09-01T00:40:24,341 adding 'lm_eval/tasks/global_mmlu/full/ha/utils.py' 2026-09-01T00:40:24,344 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml' 2026-09-01T00:40:24,345 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml' 2026-09-01T00:40:24,346 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml' 2026-09-01T00:40:24,347 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml' 2026-09-01T00:40:24,348 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml' 2026-09-01T00:40:24,350 adding 'lm_eval/tasks/global_mmlu/full/he/_he_template_yaml' 2026-09-01T00:40:24,351 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml' 2026-09-01T00:40:24,352 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml' 2026-09-01T00:40:24,353 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml' 2026-09-01T00:40:24,354 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml' 2026-09-01T00:40:24,355 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml' 2026-09-01T00:40:24,357 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml' 2026-09-01T00:40:24,358 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml' 2026-09-01T00:40:24,359 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml' 2026-09-01T00:40:24,360 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml' 2026-09-01T00:40:24,361 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml' 2026-09-01T00:40:24,363 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml' 2026-09-01T00:40:24,364 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml' 2026-09-01T00:40:24,365 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml' 2026-09-01T00:40:24,366 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml' 2026-09-01T00:40:24,368 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml' 2026-09-01T00:40:24,369 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml' 2026-09-01T00:40:24,370 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml' 2026-09-01T00:40:24,371 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml' 2026-09-01T00:40:24,372 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml' 2026-09-01T00:40:24,373 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml' 2026-09-01T00:40:24,375 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml' 2026-09-01T00:40:24,376 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml' 2026-09-01T00:40:24,377 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml' 2026-09-01T00:40:24,378 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,379 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,380 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml' 2026-09-01T00:40:24,381 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml' 2026-09-01T00:40:24,383 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml' 2026-09-01T00:40:24,384 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml' 2026-09-01T00:40:24,385 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml' 2026-09-01T00:40:24,386 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml' 2026-09-01T00:40:24,387 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml' 2026-09-01T00:40:24,389 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml' 2026-09-01T00:40:24,390 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml' 2026-09-01T00:40:24,391 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml' 2026-09-01T00:40:24,392 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml' 2026-09-01T00:40:24,393 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml' 2026-09-01T00:40:24,394 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml' 2026-09-01T00:40:24,396 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml' 2026-09-01T00:40:24,397 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml' 2026-09-01T00:40:24,398 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml' 2026-09-01T00:40:24,399 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml' 2026-09-01T00:40:24,400 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml' 2026-09-01T00:40:24,402 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml' 2026-09-01T00:40:24,403 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml' 2026-09-01T00:40:24,404 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml' 2026-09-01T00:40:24,405 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml' 2026-09-01T00:40:24,406 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml' 2026-09-01T00:40:24,408 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml' 2026-09-01T00:40:24,409 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml' 2026-09-01T00:40:24,410 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml' 2026-09-01T00:40:24,411 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml' 2026-09-01T00:40:24,412 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml' 2026-09-01T00:40:24,414 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml' 2026-09-01T00:40:24,415 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml' 2026-09-01T00:40:24,416 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml' 2026-09-01T00:40:24,417 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml' 2026-09-01T00:40:24,418 adding 'lm_eval/tasks/global_mmlu/full/he/utils.py' 2026-09-01T00:40:24,421 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml' 2026-09-01T00:40:24,422 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml' 2026-09-01T00:40:24,424 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml' 2026-09-01T00:40:24,425 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml' 2026-09-01T00:40:24,426 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml' 2026-09-01T00:40:24,427 adding 'lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml' 2026-09-01T00:40:24,428 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml' 2026-09-01T00:40:24,430 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml' 2026-09-01T00:40:24,431 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml' 2026-09-01T00:40:24,432 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml' 2026-09-01T00:40:24,433 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml' 2026-09-01T00:40:24,434 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml' 2026-09-01T00:40:24,435 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml' 2026-09-01T00:40:24,437 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml' 2026-09-01T00:40:24,438 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml' 2026-09-01T00:40:24,439 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml' 2026-09-01T00:40:24,440 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml' 2026-09-01T00:40:24,441 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml' 2026-09-01T00:40:24,442 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml' 2026-09-01T00:40:24,444 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml' 2026-09-01T00:40:24,445 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml' 2026-09-01T00:40:24,446 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml' 2026-09-01T00:40:24,447 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml' 2026-09-01T00:40:24,448 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml' 2026-09-01T00:40:24,449 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml' 2026-09-01T00:40:24,451 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml' 2026-09-01T00:40:24,452 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml' 2026-09-01T00:40:24,453 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml' 2026-09-01T00:40:24,454 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml' 2026-09-01T00:40:24,455 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,457 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,458 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml' 2026-09-01T00:40:24,459 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml' 2026-09-01T00:40:24,460 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml' 2026-09-01T00:40:24,461 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml' 2026-09-01T00:40:24,462 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml' 2026-09-01T00:40:24,463 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml' 2026-09-01T00:40:24,464 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml' 2026-09-01T00:40:24,465 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml' 2026-09-01T00:40:24,467 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml' 2026-09-01T00:40:24,468 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml' 2026-09-01T00:40:24,469 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml' 2026-09-01T00:40:24,470 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml' 2026-09-01T00:40:24,471 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml' 2026-09-01T00:40:24,472 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml' 2026-09-01T00:40:24,474 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml' 2026-09-01T00:40:24,475 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml' 2026-09-01T00:40:24,476 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml' 2026-09-01T00:40:24,477 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml' 2026-09-01T00:40:24,478 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml' 2026-09-01T00:40:24,480 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml' 2026-09-01T00:40:24,481 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml' 2026-09-01T00:40:24,482 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml' 2026-09-01T00:40:24,484 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml' 2026-09-01T00:40:24,485 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml' 2026-09-01T00:40:24,486 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml' 2026-09-01T00:40:24,487 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml' 2026-09-01T00:40:24,488 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml' 2026-09-01T00:40:24,490 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml' 2026-09-01T00:40:24,491 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml' 2026-09-01T00:40:24,492 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml' 2026-09-01T00:40:24,493 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml' 2026-09-01T00:40:24,494 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml' 2026-09-01T00:40:24,496 adding 'lm_eval/tasks/global_mmlu/full/hi/utils.py' 2026-09-01T00:40:24,499 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml' 2026-09-01T00:40:24,500 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml' 2026-09-01T00:40:24,501 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml' 2026-09-01T00:40:24,503 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml' 2026-09-01T00:40:24,504 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml' 2026-09-01T00:40:24,505 adding 'lm_eval/tasks/global_mmlu/full/id/_id_template_yaml' 2026-09-01T00:40:24,506 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml' 2026-09-01T00:40:24,508 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml' 2026-09-01T00:40:24,509 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml' 2026-09-01T00:40:24,510 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml' 2026-09-01T00:40:24,511 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml' 2026-09-01T00:40:24,512 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml' 2026-09-01T00:40:24,513 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml' 2026-09-01T00:40:24,514 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml' 2026-09-01T00:40:24,516 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml' 2026-09-01T00:40:24,517 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml' 2026-09-01T00:40:24,518 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml' 2026-09-01T00:40:24,519 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml' 2026-09-01T00:40:24,520 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml' 2026-09-01T00:40:24,522 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml' 2026-09-01T00:40:24,523 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml' 2026-09-01T00:40:24,524 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml' 2026-09-01T00:40:24,525 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml' 2026-09-01T00:40:24,526 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml' 2026-09-01T00:40:24,528 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml' 2026-09-01T00:40:24,529 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml' 2026-09-01T00:40:24,530 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml' 2026-09-01T00:40:24,531 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml' 2026-09-01T00:40:24,532 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml' 2026-09-01T00:40:24,534 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,535 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,536 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml' 2026-09-01T00:40:24,537 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml' 2026-09-01T00:40:24,539 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml' 2026-09-01T00:40:24,540 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml' 2026-09-01T00:40:24,541 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml' 2026-09-01T00:40:24,542 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml' 2026-09-01T00:40:24,543 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml' 2026-09-01T00:40:24,545 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml' 2026-09-01T00:40:24,546 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml' 2026-09-01T00:40:24,547 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml' 2026-09-01T00:40:24,549 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml' 2026-09-01T00:40:24,550 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml' 2026-09-01T00:40:24,551 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml' 2026-09-01T00:40:24,552 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml' 2026-09-01T00:40:24,553 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml' 2026-09-01T00:40:24,554 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml' 2026-09-01T00:40:24,555 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml' 2026-09-01T00:40:24,557 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml' 2026-09-01T00:40:24,558 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml' 2026-09-01T00:40:24,559 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml' 2026-09-01T00:40:24,560 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml' 2026-09-01T00:40:24,561 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml' 2026-09-01T00:40:24,563 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml' 2026-09-01T00:40:24,564 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml' 2026-09-01T00:40:24,565 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml' 2026-09-01T00:40:24,566 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml' 2026-09-01T00:40:24,567 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml' 2026-09-01T00:40:24,569 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml' 2026-09-01T00:40:24,570 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml' 2026-09-01T00:40:24,571 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml' 2026-09-01T00:40:24,572 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml' 2026-09-01T00:40:24,573 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml' 2026-09-01T00:40:24,575 adding 'lm_eval/tasks/global_mmlu/full/id/utils.py' 2026-09-01T00:40:24,578 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml' 2026-09-01T00:40:24,579 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml' 2026-09-01T00:40:24,580 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml' 2026-09-01T00:40:24,582 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml' 2026-09-01T00:40:24,583 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml' 2026-09-01T00:40:24,584 adding 'lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml' 2026-09-01T00:40:24,585 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml' 2026-09-01T00:40:24,586 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml' 2026-09-01T00:40:24,588 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml' 2026-09-01T00:40:24,589 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml' 2026-09-01T00:40:24,590 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml' 2026-09-01T00:40:24,591 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml' 2026-09-01T00:40:24,593 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml' 2026-09-01T00:40:24,594 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml' 2026-09-01T00:40:24,595 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml' 2026-09-01T00:40:24,597 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml' 2026-09-01T00:40:24,598 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml' 2026-09-01T00:40:24,599 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml' 2026-09-01T00:40:24,600 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml' 2026-09-01T00:40:24,601 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml' 2026-09-01T00:40:24,602 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml' 2026-09-01T00:40:24,604 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml' 2026-09-01T00:40:24,605 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml' 2026-09-01T00:40:24,606 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml' 2026-09-01T00:40:24,607 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml' 2026-09-01T00:40:24,608 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml' 2026-09-01T00:40:24,609 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml' 2026-09-01T00:40:24,611 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml' 2026-09-01T00:40:24,612 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml' 2026-09-01T00:40:24,613 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,614 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,616 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml' 2026-09-01T00:40:24,617 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml' 2026-09-01T00:40:24,618 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml' 2026-09-01T00:40:24,619 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml' 2026-09-01T00:40:24,620 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml' 2026-09-01T00:40:24,621 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml' 2026-09-01T00:40:24,623 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml' 2026-09-01T00:40:24,624 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml' 2026-09-01T00:40:24,625 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml' 2026-09-01T00:40:24,626 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml' 2026-09-01T00:40:24,628 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml' 2026-09-01T00:40:24,629 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml' 2026-09-01T00:40:24,630 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml' 2026-09-01T00:40:24,631 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml' 2026-09-01T00:40:24,632 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml' 2026-09-01T00:40:24,634 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml' 2026-09-01T00:40:24,635 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml' 2026-09-01T00:40:24,636 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml' 2026-09-01T00:40:24,638 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml' 2026-09-01T00:40:24,639 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml' 2026-09-01T00:40:24,640 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml' 2026-09-01T00:40:24,641 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml' 2026-09-01T00:40:24,643 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml' 2026-09-01T00:40:24,644 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml' 2026-09-01T00:40:24,645 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml' 2026-09-01T00:40:24,646 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml' 2026-09-01T00:40:24,647 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml' 2026-09-01T00:40:24,649 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml' 2026-09-01T00:40:24,650 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml' 2026-09-01T00:40:24,651 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml' 2026-09-01T00:40:24,652 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml' 2026-09-01T00:40:24,653 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml' 2026-09-01T00:40:24,655 adding 'lm_eval/tasks/global_mmlu/full/ig/utils.py' 2026-09-01T00:40:24,658 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml' 2026-09-01T00:40:24,659 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml' 2026-09-01T00:40:24,660 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml' 2026-09-01T00:40:24,661 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml' 2026-09-01T00:40:24,662 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml' 2026-09-01T00:40:24,663 adding 'lm_eval/tasks/global_mmlu/full/it/_it_template_yaml' 2026-09-01T00:40:24,665 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml' 2026-09-01T00:40:24,666 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml' 2026-09-01T00:40:24,667 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml' 2026-09-01T00:40:24,669 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml' 2026-09-01T00:40:24,670 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml' 2026-09-01T00:40:24,671 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml' 2026-09-01T00:40:24,672 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml' 2026-09-01T00:40:24,673 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml' 2026-09-01T00:40:24,675 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml' 2026-09-01T00:40:24,676 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml' 2026-09-01T00:40:24,677 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml' 2026-09-01T00:40:24,678 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml' 2026-09-01T00:40:24,679 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml' 2026-09-01T00:40:24,681 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml' 2026-09-01T00:40:24,682 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml' 2026-09-01T00:40:24,683 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml' 2026-09-01T00:40:24,684 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml' 2026-09-01T00:40:24,686 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml' 2026-09-01T00:40:24,687 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml' 2026-09-01T00:40:24,688 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml' 2026-09-01T00:40:24,689 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml' 2026-09-01T00:40:24,691 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml' 2026-09-01T00:40:24,692 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml' 2026-09-01T00:40:24,693 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,694 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,695 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml' 2026-09-01T00:40:24,697 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml' 2026-09-01T00:40:24,698 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml' 2026-09-01T00:40:24,699 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml' 2026-09-01T00:40:24,700 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml' 2026-09-01T00:40:24,701 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml' 2026-09-01T00:40:24,702 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml' 2026-09-01T00:40:24,704 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml' 2026-09-01T00:40:24,705 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml' 2026-09-01T00:40:24,706 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml' 2026-09-01T00:40:24,707 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml' 2026-09-01T00:40:24,708 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml' 2026-09-01T00:40:24,710 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml' 2026-09-01T00:40:24,711 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml' 2026-09-01T00:40:24,712 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml' 2026-09-01T00:40:24,713 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml' 2026-09-01T00:40:24,714 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml' 2026-09-01T00:40:24,716 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml' 2026-09-01T00:40:24,717 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml' 2026-09-01T00:40:24,718 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml' 2026-09-01T00:40:24,720 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml' 2026-09-01T00:40:24,721 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml' 2026-09-01T00:40:24,723 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml' 2026-09-01T00:40:24,724 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml' 2026-09-01T00:40:24,725 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml' 2026-09-01T00:40:24,727 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml' 2026-09-01T00:40:24,728 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml' 2026-09-01T00:40:24,730 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml' 2026-09-01T00:40:24,731 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml' 2026-09-01T00:40:24,733 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml' 2026-09-01T00:40:24,734 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml' 2026-09-01T00:40:24,735 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml' 2026-09-01T00:40:24,737 adding 'lm_eval/tasks/global_mmlu/full/it/utils.py' 2026-09-01T00:40:24,741 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml' 2026-09-01T00:40:24,742 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml' 2026-09-01T00:40:24,743 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml' 2026-09-01T00:40:24,744 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml' 2026-09-01T00:40:24,745 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml' 2026-09-01T00:40:24,747 adding 'lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml' 2026-09-01T00:40:24,748 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml' 2026-09-01T00:40:24,750 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml' 2026-09-01T00:40:24,751 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml' 2026-09-01T00:40:24,752 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml' 2026-09-01T00:40:24,754 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml' 2026-09-01T00:40:24,755 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml' 2026-09-01T00:40:24,756 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml' 2026-09-01T00:40:24,757 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml' 2026-09-01T00:40:24,759 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml' 2026-09-01T00:40:24,760 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml' 2026-09-01T00:40:24,761 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml' 2026-09-01T00:40:24,763 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml' 2026-09-01T00:40:24,764 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml' 2026-09-01T00:40:24,765 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml' 2026-09-01T00:40:24,766 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml' 2026-09-01T00:40:24,768 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml' 2026-09-01T00:40:24,769 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml' 2026-09-01T00:40:24,770 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml' 2026-09-01T00:40:24,772 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml' 2026-09-01T00:40:24,773 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml' 2026-09-01T00:40:24,775 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml' 2026-09-01T00:40:24,776 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml' 2026-09-01T00:40:24,777 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml' 2026-09-01T00:40:24,779 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,780 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,781 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml' 2026-09-01T00:40:24,782 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml' 2026-09-01T00:40:24,783 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml' 2026-09-01T00:40:24,785 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml' 2026-09-01T00:40:24,786 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml' 2026-09-01T00:40:24,787 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml' 2026-09-01T00:40:24,788 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml' 2026-09-01T00:40:24,790 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml' 2026-09-01T00:40:24,791 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml' 2026-09-01T00:40:24,792 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml' 2026-09-01T00:40:24,793 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml' 2026-09-01T00:40:24,794 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml' 2026-09-01T00:40:24,795 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml' 2026-09-01T00:40:24,797 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml' 2026-09-01T00:40:24,798 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml' 2026-09-01T00:40:24,799 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml' 2026-09-01T00:40:24,800 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml' 2026-09-01T00:40:24,801 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml' 2026-09-01T00:40:24,803 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml' 2026-09-01T00:40:24,804 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml' 2026-09-01T00:40:24,805 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml' 2026-09-01T00:40:24,807 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml' 2026-09-01T00:40:24,808 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml' 2026-09-01T00:40:24,809 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml' 2026-09-01T00:40:24,810 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml' 2026-09-01T00:40:24,811 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml' 2026-09-01T00:40:24,813 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml' 2026-09-01T00:40:24,814 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml' 2026-09-01T00:40:24,815 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml' 2026-09-01T00:40:24,816 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml' 2026-09-01T00:40:24,817 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml' 2026-09-01T00:40:24,819 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml' 2026-09-01T00:40:24,820 adding 'lm_eval/tasks/global_mmlu/full/ja/utils.py' 2026-09-01T00:40:24,823 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml' 2026-09-01T00:40:24,825 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml' 2026-09-01T00:40:24,826 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml' 2026-09-01T00:40:24,827 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml' 2026-09-01T00:40:24,828 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml' 2026-09-01T00:40:24,830 adding 'lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml' 2026-09-01T00:40:24,831 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml' 2026-09-01T00:40:24,832 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml' 2026-09-01T00:40:24,833 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml' 2026-09-01T00:40:24,835 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml' 2026-09-01T00:40:24,836 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml' 2026-09-01T00:40:24,837 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml' 2026-09-01T00:40:24,838 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml' 2026-09-01T00:40:24,839 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml' 2026-09-01T00:40:24,841 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml' 2026-09-01T00:40:24,842 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml' 2026-09-01T00:40:24,843 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml' 2026-09-01T00:40:24,844 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml' 2026-09-01T00:40:24,845 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml' 2026-09-01T00:40:24,847 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml' 2026-09-01T00:40:24,848 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml' 2026-09-01T00:40:24,849 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml' 2026-09-01T00:40:24,850 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml' 2026-09-01T00:40:24,851 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml' 2026-09-01T00:40:24,852 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml' 2026-09-01T00:40:24,854 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml' 2026-09-01T00:40:24,855 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml' 2026-09-01T00:40:24,856 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml' 2026-09-01T00:40:24,857 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml' 2026-09-01T00:40:24,859 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,860 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,861 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml' 2026-09-01T00:40:24,862 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml' 2026-09-01T00:40:24,863 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml' 2026-09-01T00:40:24,865 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml' 2026-09-01T00:40:24,866 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml' 2026-09-01T00:40:24,867 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml' 2026-09-01T00:40:24,868 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml' 2026-09-01T00:40:24,869 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml' 2026-09-01T00:40:24,871 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml' 2026-09-01T00:40:24,872 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml' 2026-09-01T00:40:24,873 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml' 2026-09-01T00:40:24,874 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml' 2026-09-01T00:40:24,876 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml' 2026-09-01T00:40:24,877 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml' 2026-09-01T00:40:24,878 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml' 2026-09-01T00:40:24,880 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml' 2026-09-01T00:40:24,881 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml' 2026-09-01T00:40:24,882 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml' 2026-09-01T00:40:24,883 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml' 2026-09-01T00:40:24,884 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml' 2026-09-01T00:40:24,885 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml' 2026-09-01T00:40:24,886 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml' 2026-09-01T00:40:24,888 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml' 2026-09-01T00:40:24,889 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml' 2026-09-01T00:40:24,890 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml' 2026-09-01T00:40:24,891 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml' 2026-09-01T00:40:24,893 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml' 2026-09-01T00:40:24,894 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml' 2026-09-01T00:40:24,895 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml' 2026-09-01T00:40:24,896 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml' 2026-09-01T00:40:24,897 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml' 2026-09-01T00:40:24,899 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml' 2026-09-01T00:40:24,900 adding 'lm_eval/tasks/global_mmlu/full/ko/utils.py' 2026-09-01T00:40:24,903 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml' 2026-09-01T00:40:24,904 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml' 2026-09-01T00:40:24,906 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml' 2026-09-01T00:40:24,907 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml' 2026-09-01T00:40:24,908 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml' 2026-09-01T00:40:24,910 adding 'lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml' 2026-09-01T00:40:24,911 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml' 2026-09-01T00:40:24,912 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml' 2026-09-01T00:40:24,913 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml' 2026-09-01T00:40:24,915 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml' 2026-09-01T00:40:24,916 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml' 2026-09-01T00:40:24,917 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml' 2026-09-01T00:40:24,919 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml' 2026-09-01T00:40:24,920 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml' 2026-09-01T00:40:24,922 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml' 2026-09-01T00:40:24,923 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml' 2026-09-01T00:40:24,925 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml' 2026-09-01T00:40:24,926 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml' 2026-09-01T00:40:24,928 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml' 2026-09-01T00:40:24,930 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml' 2026-09-01T00:40:24,931 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml' 2026-09-01T00:40:24,932 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml' 2026-09-01T00:40:24,933 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml' 2026-09-01T00:40:24,934 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml' 2026-09-01T00:40:24,935 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml' 2026-09-01T00:40:24,937 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml' 2026-09-01T00:40:24,938 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml' 2026-09-01T00:40:24,939 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml' 2026-09-01T00:40:24,940 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml' 2026-09-01T00:40:24,942 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml' 2026-09-01T00:40:24,943 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml' 2026-09-01T00:40:24,944 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml' 2026-09-01T00:40:24,945 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml' 2026-09-01T00:40:24,946 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml' 2026-09-01T00:40:24,948 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml' 2026-09-01T00:40:24,949 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml' 2026-09-01T00:40:24,950 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml' 2026-09-01T00:40:24,951 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml' 2026-09-01T00:40:24,952 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml' 2026-09-01T00:40:24,954 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml' 2026-09-01T00:40:24,955 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml' 2026-09-01T00:40:24,956 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml' 2026-09-01T00:40:24,957 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml' 2026-09-01T00:40:24,958 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml' 2026-09-01T00:40:24,959 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml' 2026-09-01T00:40:24,961 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml' 2026-09-01T00:40:24,962 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml' 2026-09-01T00:40:24,963 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml' 2026-09-01T00:40:24,965 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml' 2026-09-01T00:40:24,966 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml' 2026-09-01T00:40:24,967 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml' 2026-09-01T00:40:24,968 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml' 2026-09-01T00:40:24,969 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml' 2026-09-01T00:40:24,971 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml' 2026-09-01T00:40:24,972 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml' 2026-09-01T00:40:24,974 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml' 2026-09-01T00:40:24,975 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml' 2026-09-01T00:40:24,976 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml' 2026-09-01T00:40:24,977 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml' 2026-09-01T00:40:24,978 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml' 2026-09-01T00:40:24,979 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml' 2026-09-01T00:40:24,981 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml' 2026-09-01T00:40:24,982 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml' 2026-09-01T00:40:24,983 adding 'lm_eval/tasks/global_mmlu/full/ky/utils.py' 2026-09-01T00:40:24,986 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml' 2026-09-01T00:40:24,988 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml' 2026-09-01T00:40:24,989 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml' 2026-09-01T00:40:24,990 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml' 2026-09-01T00:40:24,991 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml' 2026-09-01T00:40:24,993 adding 'lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml' 2026-09-01T00:40:24,996 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml' 2026-09-01T00:40:24,997 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml' 2026-09-01T00:40:24,998 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml' 2026-09-01T00:40:25,000 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml' 2026-09-01T00:40:25,003 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml' 2026-09-01T00:40:25,005 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml' 2026-09-01T00:40:25,007 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml' 2026-09-01T00:40:25,008 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml' 2026-09-01T00:40:25,009 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml' 2026-09-01T00:40:25,011 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml' 2026-09-01T00:40:25,012 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml' 2026-09-01T00:40:25,013 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml' 2026-09-01T00:40:25,015 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml' 2026-09-01T00:40:25,018 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml' 2026-09-01T00:40:25,019 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml' 2026-09-01T00:40:25,020 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml' 2026-09-01T00:40:25,022 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml' 2026-09-01T00:40:25,023 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml' 2026-09-01T00:40:25,024 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml' 2026-09-01T00:40:25,025 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml' 2026-09-01T00:40:25,027 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml' 2026-09-01T00:40:25,028 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml' 2026-09-01T00:40:25,029 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml' 2026-09-01T00:40:25,030 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,032 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,033 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml' 2026-09-01T00:40:25,034 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml' 2026-09-01T00:40:25,035 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml' 2026-09-01T00:40:25,036 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml' 2026-09-01T00:40:25,037 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml' 2026-09-01T00:40:25,038 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml' 2026-09-01T00:40:25,040 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml' 2026-09-01T00:40:25,041 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml' 2026-09-01T00:40:25,042 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml' 2026-09-01T00:40:25,043 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml' 2026-09-01T00:40:25,044 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml' 2026-09-01T00:40:25,046 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml' 2026-09-01T00:40:25,047 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml' 2026-09-01T00:40:25,048 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml' 2026-09-01T00:40:25,049 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml' 2026-09-01T00:40:25,050 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml' 2026-09-01T00:40:25,051 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml' 2026-09-01T00:40:25,053 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml' 2026-09-01T00:40:25,054 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml' 2026-09-01T00:40:25,055 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml' 2026-09-01T00:40:25,056 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml' 2026-09-01T00:40:25,057 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml' 2026-09-01T00:40:25,059 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml' 2026-09-01T00:40:25,060 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml' 2026-09-01T00:40:25,061 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml' 2026-09-01T00:40:25,062 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml' 2026-09-01T00:40:25,063 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml' 2026-09-01T00:40:25,065 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml' 2026-09-01T00:40:25,066 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml' 2026-09-01T00:40:25,068 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml' 2026-09-01T00:40:25,069 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml' 2026-09-01T00:40:25,071 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml' 2026-09-01T00:40:25,072 adding 'lm_eval/tasks/global_mmlu/full/lt/utils.py' 2026-09-01T00:40:25,075 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml' 2026-09-01T00:40:25,077 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml' 2026-09-01T00:40:25,079 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml' 2026-09-01T00:40:25,082 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml' 2026-09-01T00:40:25,087 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml' 2026-09-01T00:40:25,089 adding 'lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml' 2026-09-01T00:40:25,093 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml' 2026-09-01T00:40:25,095 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml' 2026-09-01T00:40:25,099 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml' 2026-09-01T00:40:25,100 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml' 2026-09-01T00:40:25,101 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml' 2026-09-01T00:40:25,103 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml' 2026-09-01T00:40:25,104 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml' 2026-09-01T00:40:25,105 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml' 2026-09-01T00:40:25,107 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml' 2026-09-01T00:40:25,108 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml' 2026-09-01T00:40:25,110 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml' 2026-09-01T00:40:25,112 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml' 2026-09-01T00:40:25,114 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml' 2026-09-01T00:40:25,116 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml' 2026-09-01T00:40:25,117 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml' 2026-09-01T00:40:25,120 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml' 2026-09-01T00:40:25,122 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml' 2026-09-01T00:40:25,123 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml' 2026-09-01T00:40:25,125 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml' 2026-09-01T00:40:25,126 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml' 2026-09-01T00:40:25,128 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml' 2026-09-01T00:40:25,129 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml' 2026-09-01T00:40:25,131 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml' 2026-09-01T00:40:25,132 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,133 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,135 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml' 2026-09-01T00:40:25,137 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml' 2026-09-01T00:40:25,138 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml' 2026-09-01T00:40:25,139 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml' 2026-09-01T00:40:25,141 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml' 2026-09-01T00:40:25,142 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml' 2026-09-01T00:40:25,144 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml' 2026-09-01T00:40:25,145 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml' 2026-09-01T00:40:25,146 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml' 2026-09-01T00:40:25,148 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml' 2026-09-01T00:40:25,149 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml' 2026-09-01T00:40:25,150 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml' 2026-09-01T00:40:25,152 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml' 2026-09-01T00:40:25,153 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml' 2026-09-01T00:40:25,154 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml' 2026-09-01T00:40:25,156 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml' 2026-09-01T00:40:25,157 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml' 2026-09-01T00:40:25,158 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml' 2026-09-01T00:40:25,160 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml' 2026-09-01T00:40:25,161 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml' 2026-09-01T00:40:25,163 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml' 2026-09-01T00:40:25,164 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml' 2026-09-01T00:40:25,165 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml' 2026-09-01T00:40:25,167 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml' 2026-09-01T00:40:25,168 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml' 2026-09-01T00:40:25,169 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml' 2026-09-01T00:40:25,170 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml' 2026-09-01T00:40:25,172 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml' 2026-09-01T00:40:25,173 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml' 2026-09-01T00:40:25,174 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml' 2026-09-01T00:40:25,175 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml' 2026-09-01T00:40:25,176 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml' 2026-09-01T00:40:25,178 adding 'lm_eval/tasks/global_mmlu/full/mg/utils.py' 2026-09-01T00:40:25,181 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml' 2026-09-01T00:40:25,182 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml' 2026-09-01T00:40:25,183 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml' 2026-09-01T00:40:25,184 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml' 2026-09-01T00:40:25,186 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml' 2026-09-01T00:40:25,187 adding 'lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml' 2026-09-01T00:40:25,188 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml' 2026-09-01T00:40:25,189 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml' 2026-09-01T00:40:25,191 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml' 2026-09-01T00:40:25,192 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml' 2026-09-01T00:40:25,193 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml' 2026-09-01T00:40:25,194 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml' 2026-09-01T00:40:25,196 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml' 2026-09-01T00:40:25,197 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml' 2026-09-01T00:40:25,198 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml' 2026-09-01T00:40:25,199 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml' 2026-09-01T00:40:25,200 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml' 2026-09-01T00:40:25,201 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml' 2026-09-01T00:40:25,202 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml' 2026-09-01T00:40:25,204 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml' 2026-09-01T00:40:25,205 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml' 2026-09-01T00:40:25,206 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml' 2026-09-01T00:40:25,207 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml' 2026-09-01T00:40:25,208 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml' 2026-09-01T00:40:25,210 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml' 2026-09-01T00:40:25,211 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml' 2026-09-01T00:40:25,212 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml' 2026-09-01T00:40:25,213 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml' 2026-09-01T00:40:25,214 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml' 2026-09-01T00:40:25,218 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,219 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,221 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml' 2026-09-01T00:40:25,222 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml' 2026-09-01T00:40:25,224 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml' 2026-09-01T00:40:25,225 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml' 2026-09-01T00:40:25,226 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml' 2026-09-01T00:40:25,228 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml' 2026-09-01T00:40:25,229 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml' 2026-09-01T00:40:25,231 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml' 2026-09-01T00:40:25,233 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml' 2026-09-01T00:40:25,234 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml' 2026-09-01T00:40:25,235 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml' 2026-09-01T00:40:25,237 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml' 2026-09-01T00:40:25,238 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml' 2026-09-01T00:40:25,240 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml' 2026-09-01T00:40:25,241 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml' 2026-09-01T00:40:25,242 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml' 2026-09-01T00:40:25,244 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml' 2026-09-01T00:40:25,246 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml' 2026-09-01T00:40:25,247 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml' 2026-09-01T00:40:25,248 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml' 2026-09-01T00:40:25,250 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml' 2026-09-01T00:40:25,251 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml' 2026-09-01T00:40:25,253 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml' 2026-09-01T00:40:25,254 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml' 2026-09-01T00:40:25,255 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml' 2026-09-01T00:40:25,257 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml' 2026-09-01T00:40:25,259 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml' 2026-09-01T00:40:25,260 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml' 2026-09-01T00:40:25,262 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml' 2026-09-01T00:40:25,263 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml' 2026-09-01T00:40:25,265 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml' 2026-09-01T00:40:25,266 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml' 2026-09-01T00:40:25,268 adding 'lm_eval/tasks/global_mmlu/full/ms/utils.py' 2026-09-01T00:40:25,272 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml' 2026-09-01T00:40:25,273 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml' 2026-09-01T00:40:25,275 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml' 2026-09-01T00:40:25,276 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml' 2026-09-01T00:40:25,277 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml' 2026-09-01T00:40:25,279 adding 'lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml' 2026-09-01T00:40:25,281 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml' 2026-09-01T00:40:25,282 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml' 2026-09-01T00:40:25,284 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml' 2026-09-01T00:40:25,285 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml' 2026-09-01T00:40:25,287 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml' 2026-09-01T00:40:25,288 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml' 2026-09-01T00:40:25,290 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml' 2026-09-01T00:40:25,292 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml' 2026-09-01T00:40:25,293 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml' 2026-09-01T00:40:25,294 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml' 2026-09-01T00:40:25,296 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml' 2026-09-01T00:40:25,298 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml' 2026-09-01T00:40:25,299 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml' 2026-09-01T00:40:25,301 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml' 2026-09-01T00:40:25,302 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml' 2026-09-01T00:40:25,303 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml' 2026-09-01T00:40:25,305 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml' 2026-09-01T00:40:25,307 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml' 2026-09-01T00:40:25,308 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml' 2026-09-01T00:40:25,310 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml' 2026-09-01T00:40:25,311 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml' 2026-09-01T00:40:25,313 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml' 2026-09-01T00:40:25,314 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml' 2026-09-01T00:40:25,316 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,317 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,318 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml' 2026-09-01T00:40:25,320 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml' 2026-09-01T00:40:25,322 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml' 2026-09-01T00:40:25,325 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml' 2026-09-01T00:40:25,326 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml' 2026-09-01T00:40:25,327 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml' 2026-09-01T00:40:25,329 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml' 2026-09-01T00:40:25,330 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml' 2026-09-01T00:40:25,331 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml' 2026-09-01T00:40:25,333 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml' 2026-09-01T00:40:25,334 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml' 2026-09-01T00:40:25,335 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml' 2026-09-01T00:40:25,337 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml' 2026-09-01T00:40:25,338 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml' 2026-09-01T00:40:25,340 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml' 2026-09-01T00:40:25,342 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml' 2026-09-01T00:40:25,343 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml' 2026-09-01T00:40:25,344 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml' 2026-09-01T00:40:25,346 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml' 2026-09-01T00:40:25,347 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml' 2026-09-01T00:40:25,349 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml' 2026-09-01T00:40:25,350 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml' 2026-09-01T00:40:25,351 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml' 2026-09-01T00:40:25,353 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml' 2026-09-01T00:40:25,355 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml' 2026-09-01T00:40:25,357 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml' 2026-09-01T00:40:25,358 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml' 2026-09-01T00:40:25,359 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml' 2026-09-01T00:40:25,361 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml' 2026-09-01T00:40:25,362 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml' 2026-09-01T00:40:25,364 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml' 2026-09-01T00:40:25,365 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml' 2026-09-01T00:40:25,366 adding 'lm_eval/tasks/global_mmlu/full/ne/utils.py' 2026-09-01T00:40:25,370 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml' 2026-09-01T00:40:25,371 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml' 2026-09-01T00:40:25,372 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml' 2026-09-01T00:40:25,373 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml' 2026-09-01T00:40:25,375 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml' 2026-09-01T00:40:25,376 adding 'lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml' 2026-09-01T00:40:25,377 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml' 2026-09-01T00:40:25,378 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml' 2026-09-01T00:40:25,380 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml' 2026-09-01T00:40:25,381 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml' 2026-09-01T00:40:25,382 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml' 2026-09-01T00:40:25,383 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml' 2026-09-01T00:40:25,385 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml' 2026-09-01T00:40:25,386 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml' 2026-09-01T00:40:25,387 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml' 2026-09-01T00:40:25,388 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml' 2026-09-01T00:40:25,390 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml' 2026-09-01T00:40:25,391 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml' 2026-09-01T00:40:25,392 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml' 2026-09-01T00:40:25,394 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml' 2026-09-01T00:40:25,395 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml' 2026-09-01T00:40:25,396 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml' 2026-09-01T00:40:25,397 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml' 2026-09-01T00:40:25,399 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml' 2026-09-01T00:40:25,400 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml' 2026-09-01T00:40:25,401 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml' 2026-09-01T00:40:25,402 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml' 2026-09-01T00:40:25,404 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml' 2026-09-01T00:40:25,405 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml' 2026-09-01T00:40:25,407 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,408 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,410 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml' 2026-09-01T00:40:25,411 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml' 2026-09-01T00:40:25,412 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml' 2026-09-01T00:40:25,413 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml' 2026-09-01T00:40:25,414 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml' 2026-09-01T00:40:25,415 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml' 2026-09-01T00:40:25,417 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml' 2026-09-01T00:40:25,418 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml' 2026-09-01T00:40:25,419 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml' 2026-09-01T00:40:25,420 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml' 2026-09-01T00:40:25,421 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml' 2026-09-01T00:40:25,422 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml' 2026-09-01T00:40:25,424 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml' 2026-09-01T00:40:25,425 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml' 2026-09-01T00:40:25,426 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml' 2026-09-01T00:40:25,427 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml' 2026-09-01T00:40:25,429 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml' 2026-09-01T00:40:25,434 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml' 2026-09-01T00:40:25,435 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml' 2026-09-01T00:40:25,437 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml' 2026-09-01T00:40:25,438 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml' 2026-09-01T00:40:25,439 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml' 2026-09-01T00:40:25,440 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml' 2026-09-01T00:40:25,441 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml' 2026-09-01T00:40:25,443 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml' 2026-09-01T00:40:25,444 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml' 2026-09-01T00:40:25,445 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml' 2026-09-01T00:40:25,446 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml' 2026-09-01T00:40:25,448 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml' 2026-09-01T00:40:25,449 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml' 2026-09-01T00:40:25,450 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml' 2026-09-01T00:40:25,451 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml' 2026-09-01T00:40:25,453 adding 'lm_eval/tasks/global_mmlu/full/nl/utils.py' 2026-09-01T00:40:25,456 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml' 2026-09-01T00:40:25,457 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml' 2026-09-01T00:40:25,458 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml' 2026-09-01T00:40:25,460 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml' 2026-09-01T00:40:25,461 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml' 2026-09-01T00:40:25,462 adding 'lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml' 2026-09-01T00:40:25,464 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml' 2026-09-01T00:40:25,466 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml' 2026-09-01T00:40:25,467 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml' 2026-09-01T00:40:25,468 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml' 2026-09-01T00:40:25,469 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml' 2026-09-01T00:40:25,470 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml' 2026-09-01T00:40:25,471 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml' 2026-09-01T00:40:25,472 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml' 2026-09-01T00:40:25,474 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml' 2026-09-01T00:40:25,475 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml' 2026-09-01T00:40:25,476 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml' 2026-09-01T00:40:25,477 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml' 2026-09-01T00:40:25,479 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml' 2026-09-01T00:40:25,480 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml' 2026-09-01T00:40:25,481 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml' 2026-09-01T00:40:25,482 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml' 2026-09-01T00:40:25,483 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml' 2026-09-01T00:40:25,484 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml' 2026-09-01T00:40:25,486 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml' 2026-09-01T00:40:25,487 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml' 2026-09-01T00:40:25,488 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml' 2026-09-01T00:40:25,489 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml' 2026-09-01T00:40:25,490 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml' 2026-09-01T00:40:25,492 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,493 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,495 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml' 2026-09-01T00:40:25,496 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml' 2026-09-01T00:40:25,497 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml' 2026-09-01T00:40:25,499 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml' 2026-09-01T00:40:25,500 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml' 2026-09-01T00:40:25,501 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml' 2026-09-01T00:40:25,503 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml' 2026-09-01T00:40:25,504 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml' 2026-09-01T00:40:25,506 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml' 2026-09-01T00:40:25,507 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml' 2026-09-01T00:40:25,508 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml' 2026-09-01T00:40:25,510 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml' 2026-09-01T00:40:25,511 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml' 2026-09-01T00:40:25,512 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml' 2026-09-01T00:40:25,514 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml' 2026-09-01T00:40:25,515 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml' 2026-09-01T00:40:25,516 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml' 2026-09-01T00:40:25,517 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml' 2026-09-01T00:40:25,519 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml' 2026-09-01T00:40:25,520 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml' 2026-09-01T00:40:25,521 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml' 2026-09-01T00:40:25,522 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml' 2026-09-01T00:40:25,524 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml' 2026-09-01T00:40:25,525 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml' 2026-09-01T00:40:25,526 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml' 2026-09-01T00:40:25,527 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml' 2026-09-01T00:40:25,529 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml' 2026-09-01T00:40:25,530 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml' 2026-09-01T00:40:25,531 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml' 2026-09-01T00:40:25,532 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml' 2026-09-01T00:40:25,533 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml' 2026-09-01T00:40:25,535 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml' 2026-09-01T00:40:25,536 adding 'lm_eval/tasks/global_mmlu/full/ny/utils.py' 2026-09-01T00:40:25,539 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml' 2026-09-01T00:40:25,540 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml' 2026-09-01T00:40:25,541 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml' 2026-09-01T00:40:25,542 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml' 2026-09-01T00:40:25,544 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml' 2026-09-01T00:40:25,545 adding 'lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml' 2026-09-01T00:40:25,546 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml' 2026-09-01T00:40:25,548 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml' 2026-09-01T00:40:25,549 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml' 2026-09-01T00:40:25,550 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml' 2026-09-01T00:40:25,551 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml' 2026-09-01T00:40:25,553 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml' 2026-09-01T00:40:25,554 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml' 2026-09-01T00:40:25,555 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml' 2026-09-01T00:40:25,556 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml' 2026-09-01T00:40:25,558 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml' 2026-09-01T00:40:25,559 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml' 2026-09-01T00:40:25,560 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml' 2026-09-01T00:40:25,561 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml' 2026-09-01T00:40:25,562 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml' 2026-09-01T00:40:25,564 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml' 2026-09-01T00:40:25,568 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml' 2026-09-01T00:40:25,568 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml' 2026-09-01T00:40:25,569 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml' 2026-09-01T00:40:25,570 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml' 2026-09-01T00:40:25,571 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml' 2026-09-01T00:40:25,574 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml' 2026-09-01T00:40:25,575 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml' 2026-09-01T00:40:25,577 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml' 2026-09-01T00:40:25,578 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,579 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,581 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml' 2026-09-01T00:40:25,582 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml' 2026-09-01T00:40:25,583 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml' 2026-09-01T00:40:25,585 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml' 2026-09-01T00:40:25,586 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml' 2026-09-01T00:40:25,588 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml' 2026-09-01T00:40:25,589 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml' 2026-09-01T00:40:25,590 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml' 2026-09-01T00:40:25,592 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml' 2026-09-01T00:40:25,593 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml' 2026-09-01T00:40:25,594 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml' 2026-09-01T00:40:25,596 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml' 2026-09-01T00:40:25,597 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml' 2026-09-01T00:40:25,598 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml' 2026-09-01T00:40:25,599 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml' 2026-09-01T00:40:25,601 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml' 2026-09-01T00:40:25,602 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml' 2026-09-01T00:40:25,604 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml' 2026-09-01T00:40:25,607 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml' 2026-09-01T00:40:25,610 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml' 2026-09-01T00:40:25,613 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml' 2026-09-01T00:40:25,618 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml' 2026-09-01T00:40:25,621 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml' 2026-09-01T00:40:25,622 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml' 2026-09-01T00:40:25,624 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml' 2026-09-01T00:40:25,625 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml' 2026-09-01T00:40:25,627 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml' 2026-09-01T00:40:25,628 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml' 2026-09-01T00:40:25,630 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml' 2026-09-01T00:40:25,631 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml' 2026-09-01T00:40:25,632 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml' 2026-09-01T00:40:25,634 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml' 2026-09-01T00:40:25,636 adding 'lm_eval/tasks/global_mmlu/full/pl/utils.py' 2026-09-01T00:40:25,639 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml' 2026-09-01T00:40:25,640 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml' 2026-09-01T00:40:25,641 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml' 2026-09-01T00:40:25,643 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml' 2026-09-01T00:40:25,644 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml' 2026-09-01T00:40:25,646 adding 'lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml' 2026-09-01T00:40:25,649 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml' 2026-09-01T00:40:25,650 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml' 2026-09-01T00:40:25,651 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml' 2026-09-01T00:40:25,653 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml' 2026-09-01T00:40:25,654 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml' 2026-09-01T00:40:25,655 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml' 2026-09-01T00:40:25,657 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml' 2026-09-01T00:40:25,658 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml' 2026-09-01T00:40:25,659 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml' 2026-09-01T00:40:25,660 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml' 2026-09-01T00:40:25,662 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml' 2026-09-01T00:40:25,663 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml' 2026-09-01T00:40:25,664 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml' 2026-09-01T00:40:25,666 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml' 2026-09-01T00:40:25,667 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml' 2026-09-01T00:40:25,668 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml' 2026-09-01T00:40:25,669 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml' 2026-09-01T00:40:25,670 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml' 2026-09-01T00:40:25,672 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml' 2026-09-01T00:40:25,673 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml' 2026-09-01T00:40:25,674 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml' 2026-09-01T00:40:25,675 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml' 2026-09-01T00:40:25,676 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml' 2026-09-01T00:40:25,678 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,679 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,680 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml' 2026-09-01T00:40:25,681 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml' 2026-09-01T00:40:25,682 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml' 2026-09-01T00:40:25,684 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml' 2026-09-01T00:40:25,685 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml' 2026-09-01T00:40:25,686 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml' 2026-09-01T00:40:25,687 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml' 2026-09-01T00:40:25,689 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml' 2026-09-01T00:40:25,690 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml' 2026-09-01T00:40:25,691 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml' 2026-09-01T00:40:25,692 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml' 2026-09-01T00:40:25,693 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml' 2026-09-01T00:40:25,695 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml' 2026-09-01T00:40:25,696 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml' 2026-09-01T00:40:25,697 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml' 2026-09-01T00:40:25,699 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml' 2026-09-01T00:40:25,700 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml' 2026-09-01T00:40:25,701 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml' 2026-09-01T00:40:25,702 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml' 2026-09-01T00:40:25,703 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml' 2026-09-01T00:40:25,704 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml' 2026-09-01T00:40:25,706 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml' 2026-09-01T00:40:25,707 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml' 2026-09-01T00:40:25,708 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml' 2026-09-01T00:40:25,709 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml' 2026-09-01T00:40:25,710 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml' 2026-09-01T00:40:25,712 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml' 2026-09-01T00:40:25,713 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml' 2026-09-01T00:40:25,714 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml' 2026-09-01T00:40:25,715 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml' 2026-09-01T00:40:25,717 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml' 2026-09-01T00:40:25,718 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml' 2026-09-01T00:40:25,719 adding 'lm_eval/tasks/global_mmlu/full/pt/utils.py' 2026-09-01T00:40:25,722 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml' 2026-09-01T00:40:25,724 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml' 2026-09-01T00:40:25,726 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml' 2026-09-01T00:40:25,727 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml' 2026-09-01T00:40:25,729 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml' 2026-09-01T00:40:25,730 adding 'lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml' 2026-09-01T00:40:25,731 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml' 2026-09-01T00:40:25,732 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml' 2026-09-01T00:40:25,734 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml' 2026-09-01T00:40:25,735 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml' 2026-09-01T00:40:25,738 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml' 2026-09-01T00:40:25,739 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml' 2026-09-01T00:40:25,741 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml' 2026-09-01T00:40:25,742 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml' 2026-09-01T00:40:25,743 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml' 2026-09-01T00:40:25,744 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml' 2026-09-01T00:40:25,746 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml' 2026-09-01T00:40:25,747 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml' 2026-09-01T00:40:25,749 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml' 2026-09-01T00:40:25,751 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml' 2026-09-01T00:40:25,752 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml' 2026-09-01T00:40:25,753 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml' 2026-09-01T00:40:25,755 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml' 2026-09-01T00:40:25,756 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml' 2026-09-01T00:40:25,757 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml' 2026-09-01T00:40:25,759 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml' 2026-09-01T00:40:25,760 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml' 2026-09-01T00:40:25,762 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml' 2026-09-01T00:40:25,763 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml' 2026-09-01T00:40:25,765 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,766 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,767 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml' 2026-09-01T00:40:25,769 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml' 2026-09-01T00:40:25,770 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml' 2026-09-01T00:40:25,772 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml' 2026-09-01T00:40:25,773 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml' 2026-09-01T00:40:25,775 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml' 2026-09-01T00:40:25,776 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml' 2026-09-01T00:40:25,777 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml' 2026-09-01T00:40:25,778 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml' 2026-09-01T00:40:25,780 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml' 2026-09-01T00:40:25,781 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml' 2026-09-01T00:40:25,782 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml' 2026-09-01T00:40:25,783 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml' 2026-09-01T00:40:25,785 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml' 2026-09-01T00:40:25,786 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml' 2026-09-01T00:40:25,787 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml' 2026-09-01T00:40:25,789 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml' 2026-09-01T00:40:25,790 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml' 2026-09-01T00:40:25,791 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml' 2026-09-01T00:40:25,792 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml' 2026-09-01T00:40:25,794 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml' 2026-09-01T00:40:25,795 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml' 2026-09-01T00:40:25,796 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml' 2026-09-01T00:40:25,798 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml' 2026-09-01T00:40:25,799 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml' 2026-09-01T00:40:25,800 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml' 2026-09-01T00:40:25,802 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml' 2026-09-01T00:40:25,803 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml' 2026-09-01T00:40:25,804 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml' 2026-09-01T00:40:25,806 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml' 2026-09-01T00:40:25,807 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml' 2026-09-01T00:40:25,808 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml' 2026-09-01T00:40:25,810 adding 'lm_eval/tasks/global_mmlu/full/ro/utils.py' 2026-09-01T00:40:25,813 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml' 2026-09-01T00:40:25,815 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml' 2026-09-01T00:40:25,816 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml' 2026-09-01T00:40:25,817 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml' 2026-09-01T00:40:25,819 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml' 2026-09-01T00:40:25,820 adding 'lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml' 2026-09-01T00:40:25,821 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml' 2026-09-01T00:40:25,823 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml' 2026-09-01T00:40:25,825 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml' 2026-09-01T00:40:25,826 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml' 2026-09-01T00:40:25,828 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml' 2026-09-01T00:40:25,829 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml' 2026-09-01T00:40:25,830 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml' 2026-09-01T00:40:25,831 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml' 2026-09-01T00:40:25,832 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml' 2026-09-01T00:40:25,834 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml' 2026-09-01T00:40:25,835 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml' 2026-09-01T00:40:25,836 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml' 2026-09-01T00:40:25,837 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml' 2026-09-01T00:40:25,839 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml' 2026-09-01T00:40:25,840 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml' 2026-09-01T00:40:25,841 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml' 2026-09-01T00:40:25,843 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml' 2026-09-01T00:40:25,844 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml' 2026-09-01T00:40:25,845 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml' 2026-09-01T00:40:25,846 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml' 2026-09-01T00:40:25,848 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml' 2026-09-01T00:40:25,849 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml' 2026-09-01T00:40:25,850 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml' 2026-09-01T00:40:25,852 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,853 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,855 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml' 2026-09-01T00:40:25,856 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml' 2026-09-01T00:40:25,857 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml' 2026-09-01T00:40:25,859 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml' 2026-09-01T00:40:25,860 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml' 2026-09-01T00:40:25,861 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml' 2026-09-01T00:40:25,863 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml' 2026-09-01T00:40:25,864 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml' 2026-09-01T00:40:25,866 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml' 2026-09-01T00:40:25,867 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml' 2026-09-01T00:40:25,868 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml' 2026-09-01T00:40:25,870 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml' 2026-09-01T00:40:25,871 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml' 2026-09-01T00:40:25,873 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml' 2026-09-01T00:40:25,874 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml' 2026-09-01T00:40:25,875 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml' 2026-09-01T00:40:25,877 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml' 2026-09-01T00:40:25,878 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml' 2026-09-01T00:40:25,879 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml' 2026-09-01T00:40:25,880 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml' 2026-09-01T00:40:25,881 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml' 2026-09-01T00:40:25,883 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml' 2026-09-01T00:40:25,884 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml' 2026-09-01T00:40:25,885 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml' 2026-09-01T00:40:25,887 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml' 2026-09-01T00:40:25,888 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml' 2026-09-01T00:40:25,889 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml' 2026-09-01T00:40:25,890 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml' 2026-09-01T00:40:25,892 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml' 2026-09-01T00:40:25,893 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml' 2026-09-01T00:40:25,894 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml' 2026-09-01T00:40:25,896 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml' 2026-09-01T00:40:25,897 adding 'lm_eval/tasks/global_mmlu/full/ru/utils.py' 2026-09-01T00:40:25,901 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml' 2026-09-01T00:40:25,902 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml' 2026-09-01T00:40:25,903 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml' 2026-09-01T00:40:25,904 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml' 2026-09-01T00:40:25,906 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml' 2026-09-01T00:40:25,907 adding 'lm_eval/tasks/global_mmlu/full/si/_si_template_yaml' 2026-09-01T00:40:25,908 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml' 2026-09-01T00:40:25,910 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml' 2026-09-01T00:40:25,911 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml' 2026-09-01T00:40:25,912 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml' 2026-09-01T00:40:25,914 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml' 2026-09-01T00:40:25,915 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml' 2026-09-01T00:40:25,916 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml' 2026-09-01T00:40:25,918 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml' 2026-09-01T00:40:25,919 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml' 2026-09-01T00:40:25,920 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml' 2026-09-01T00:40:25,922 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml' 2026-09-01T00:40:25,924 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml' 2026-09-01T00:40:25,925 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml' 2026-09-01T00:40:25,926 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml' 2026-09-01T00:40:25,928 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml' 2026-09-01T00:40:25,930 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml' 2026-09-01T00:40:25,934 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml' 2026-09-01T00:40:25,938 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml' 2026-09-01T00:40:25,955 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml' 2026-09-01T00:40:25,956 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml' 2026-09-01T00:40:25,956 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml' 2026-09-01T00:40:25,957 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml' 2026-09-01T00:40:25,957 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml' 2026-09-01T00:40:25,958 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml' 2026-09-01T00:40:25,958 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml' 2026-09-01T00:40:25,959 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml' 2026-09-01T00:40:25,960 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml' 2026-09-01T00:40:25,960 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml' 2026-09-01T00:40:25,961 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml' 2026-09-01T00:40:25,961 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml' 2026-09-01T00:40:25,962 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml' 2026-09-01T00:40:25,964 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml' 2026-09-01T00:40:25,965 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml' 2026-09-01T00:40:25,967 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml' 2026-09-01T00:40:25,968 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml' 2026-09-01T00:40:25,969 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml' 2026-09-01T00:40:25,971 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml' 2026-09-01T00:40:25,973 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml' 2026-09-01T00:40:25,974 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml' 2026-09-01T00:40:25,976 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml' 2026-09-01T00:40:25,977 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml' 2026-09-01T00:40:25,979 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml' 2026-09-01T00:40:25,980 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml' 2026-09-01T00:40:25,982 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml' 2026-09-01T00:40:25,984 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml' 2026-09-01T00:40:25,985 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml' 2026-09-01T00:40:25,987 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml' 2026-09-01T00:40:25,989 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml' 2026-09-01T00:40:25,990 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml' 2026-09-01T00:40:25,992 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml' 2026-09-01T00:40:25,993 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml' 2026-09-01T00:40:25,995 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml' 2026-09-01T00:40:25,996 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml' 2026-09-01T00:40:25,998 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml' 2026-09-01T00:40:25,999 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml' 2026-09-01T00:40:26,001 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml' 2026-09-01T00:40:26,002 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml' 2026-09-01T00:40:26,004 adding 'lm_eval/tasks/global_mmlu/full/si/utils.py' 2026-09-01T00:40:26,007 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml' 2026-09-01T00:40:26,009 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml' 2026-09-01T00:40:26,010 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml' 2026-09-01T00:40:26,012 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml' 2026-09-01T00:40:26,014 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml' 2026-09-01T00:40:26,015 adding 'lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml' 2026-09-01T00:40:26,017 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml' 2026-09-01T00:40:26,018 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml' 2026-09-01T00:40:26,019 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml' 2026-09-01T00:40:26,021 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml' 2026-09-01T00:40:26,022 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml' 2026-09-01T00:40:26,023 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml' 2026-09-01T00:40:26,025 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml' 2026-09-01T00:40:26,026 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml' 2026-09-01T00:40:26,028 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml' 2026-09-01T00:40:26,029 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml' 2026-09-01T00:40:26,031 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml' 2026-09-01T00:40:26,032 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml' 2026-09-01T00:40:26,033 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml' 2026-09-01T00:40:26,035 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml' 2026-09-01T00:40:26,036 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml' 2026-09-01T00:40:26,038 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml' 2026-09-01T00:40:26,039 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml' 2026-09-01T00:40:26,041 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml' 2026-09-01T00:40:26,042 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml' 2026-09-01T00:40:26,044 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml' 2026-09-01T00:40:26,045 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml' 2026-09-01T00:40:26,046 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml' 2026-09-01T00:40:26,048 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml' 2026-09-01T00:40:26,050 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,051 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,052 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml' 2026-09-01T00:40:26,054 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml' 2026-09-01T00:40:26,055 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml' 2026-09-01T00:40:26,056 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml' 2026-09-01T00:40:26,058 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml' 2026-09-01T00:40:26,059 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml' 2026-09-01T00:40:26,060 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml' 2026-09-01T00:40:26,062 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml' 2026-09-01T00:40:26,063 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml' 2026-09-01T00:40:26,064 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml' 2026-09-01T00:40:26,066 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml' 2026-09-01T00:40:26,067 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml' 2026-09-01T00:40:26,068 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml' 2026-09-01T00:40:26,070 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml' 2026-09-01T00:40:26,071 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml' 2026-09-01T00:40:26,072 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml' 2026-09-01T00:40:26,074 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml' 2026-09-01T00:40:26,075 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml' 2026-09-01T00:40:26,076 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml' 2026-09-01T00:40:26,078 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml' 2026-09-01T00:40:26,079 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml' 2026-09-01T00:40:26,080 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml' 2026-09-01T00:40:26,082 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml' 2026-09-01T00:40:26,083 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml' 2026-09-01T00:40:26,085 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml' 2026-09-01T00:40:26,086 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml' 2026-09-01T00:40:26,088 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml' 2026-09-01T00:40:26,089 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml' 2026-09-01T00:40:26,090 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml' 2026-09-01T00:40:26,092 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml' 2026-09-01T00:40:26,093 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml' 2026-09-01T00:40:26,095 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml' 2026-09-01T00:40:26,096 adding 'lm_eval/tasks/global_mmlu/full/sn/utils.py' 2026-09-01T00:40:26,099 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml' 2026-09-01T00:40:26,101 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml' 2026-09-01T00:40:26,102 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml' 2026-09-01T00:40:26,104 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml' 2026-09-01T00:40:26,105 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml' 2026-09-01T00:40:26,107 adding 'lm_eval/tasks/global_mmlu/full/so/_so_template_yaml' 2026-09-01T00:40:26,108 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml' 2026-09-01T00:40:26,110 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml' 2026-09-01T00:40:26,111 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml' 2026-09-01T00:40:26,113 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml' 2026-09-01T00:40:26,114 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml' 2026-09-01T00:40:26,115 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml' 2026-09-01T00:40:26,117 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml' 2026-09-01T00:40:26,118 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml' 2026-09-01T00:40:26,119 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml' 2026-09-01T00:40:26,121 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml' 2026-09-01T00:40:26,122 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml' 2026-09-01T00:40:26,124 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml' 2026-09-01T00:40:26,125 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml' 2026-09-01T00:40:26,127 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml' 2026-09-01T00:40:26,128 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml' 2026-09-01T00:40:26,129 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml' 2026-09-01T00:40:26,131 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml' 2026-09-01T00:40:26,132 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml' 2026-09-01T00:40:26,134 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml' 2026-09-01T00:40:26,135 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml' 2026-09-01T00:40:26,136 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml' 2026-09-01T00:40:26,138 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml' 2026-09-01T00:40:26,139 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml' 2026-09-01T00:40:26,140 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,142 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,143 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml' 2026-09-01T00:40:26,145 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml' 2026-09-01T00:40:26,146 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml' 2026-09-01T00:40:26,148 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml' 2026-09-01T00:40:26,150 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml' 2026-09-01T00:40:26,151 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml' 2026-09-01T00:40:26,153 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml' 2026-09-01T00:40:26,155 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml' 2026-09-01T00:40:26,156 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml' 2026-09-01T00:40:26,157 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml' 2026-09-01T00:40:26,158 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml' 2026-09-01T00:40:26,160 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml' 2026-09-01T00:40:26,161 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml' 2026-09-01T00:40:26,162 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml' 2026-09-01T00:40:26,163 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml' 2026-09-01T00:40:26,165 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml' 2026-09-01T00:40:26,166 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml' 2026-09-01T00:40:26,167 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml' 2026-09-01T00:40:26,169 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml' 2026-09-01T00:40:26,170 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml' 2026-09-01T00:40:26,172 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml' 2026-09-01T00:40:26,173 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml' 2026-09-01T00:40:26,174 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml' 2026-09-01T00:40:26,175 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml' 2026-09-01T00:40:26,177 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml' 2026-09-01T00:40:26,178 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml' 2026-09-01T00:40:26,179 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml' 2026-09-01T00:40:26,181 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml' 2026-09-01T00:40:26,182 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml' 2026-09-01T00:40:26,183 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml' 2026-09-01T00:40:26,185 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml' 2026-09-01T00:40:26,186 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml' 2026-09-01T00:40:26,188 adding 'lm_eval/tasks/global_mmlu/full/so/utils.py' 2026-09-01T00:40:26,191 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml' 2026-09-01T00:40:26,192 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml' 2026-09-01T00:40:26,194 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml' 2026-09-01T00:40:26,195 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml' 2026-09-01T00:40:26,197 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml' 2026-09-01T00:40:26,198 adding 'lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml' 2026-09-01T00:40:26,199 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml' 2026-09-01T00:40:26,201 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml' 2026-09-01T00:40:26,202 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml' 2026-09-01T00:40:26,204 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml' 2026-09-01T00:40:26,205 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml' 2026-09-01T00:40:26,206 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml' 2026-09-01T00:40:26,208 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml' 2026-09-01T00:40:26,209 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml' 2026-09-01T00:40:26,210 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml' 2026-09-01T00:40:26,211 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml' 2026-09-01T00:40:26,213 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml' 2026-09-01T00:40:26,214 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml' 2026-09-01T00:40:26,215 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml' 2026-09-01T00:40:26,217 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml' 2026-09-01T00:40:26,218 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml' 2026-09-01T00:40:26,219 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml' 2026-09-01T00:40:26,220 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml' 2026-09-01T00:40:26,222 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml' 2026-09-01T00:40:26,223 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml' 2026-09-01T00:40:26,224 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml' 2026-09-01T00:40:26,225 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml' 2026-09-01T00:40:26,227 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml' 2026-09-01T00:40:26,228 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml' 2026-09-01T00:40:26,230 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,231 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,232 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml' 2026-09-01T00:40:26,234 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml' 2026-09-01T00:40:26,235 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml' 2026-09-01T00:40:26,236 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml' 2026-09-01T00:40:26,238 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml' 2026-09-01T00:40:26,239 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml' 2026-09-01T00:40:26,241 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml' 2026-09-01T00:40:26,242 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml' 2026-09-01T00:40:26,243 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml' 2026-09-01T00:40:26,245 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml' 2026-09-01T00:40:26,246 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml' 2026-09-01T00:40:26,248 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml' 2026-09-01T00:40:26,249 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml' 2026-09-01T00:40:26,250 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml' 2026-09-01T00:40:26,252 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml' 2026-09-01T00:40:26,253 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml' 2026-09-01T00:40:26,254 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml' 2026-09-01T00:40:26,256 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml' 2026-09-01T00:40:26,257 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml' 2026-09-01T00:40:26,258 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml' 2026-09-01T00:40:26,260 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml' 2026-09-01T00:40:26,261 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml' 2026-09-01T00:40:26,262 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml' 2026-09-01T00:40:26,263 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml' 2026-09-01T00:40:26,265 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml' 2026-09-01T00:40:26,266 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml' 2026-09-01T00:40:26,267 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml' 2026-09-01T00:40:26,269 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml' 2026-09-01T00:40:26,270 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml' 2026-09-01T00:40:26,271 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml' 2026-09-01T00:40:26,272 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml' 2026-09-01T00:40:26,273 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml' 2026-09-01T00:40:26,275 adding 'lm_eval/tasks/global_mmlu/full/sr/utils.py' 2026-09-01T00:40:26,278 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml' 2026-09-01T00:40:26,280 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml' 2026-09-01T00:40:26,281 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml' 2026-09-01T00:40:26,282 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml' 2026-09-01T00:40:26,284 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml' 2026-09-01T00:40:26,285 adding 'lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml' 2026-09-01T00:40:26,287 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml' 2026-09-01T00:40:26,288 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml' 2026-09-01T00:40:26,289 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml' 2026-09-01T00:40:26,290 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml' 2026-09-01T00:40:26,292 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml' 2026-09-01T00:40:26,293 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml' 2026-09-01T00:40:26,294 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml' 2026-09-01T00:40:26,296 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml' 2026-09-01T00:40:26,297 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml' 2026-09-01T00:40:26,299 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml' 2026-09-01T00:40:26,300 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml' 2026-09-01T00:40:26,302 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml' 2026-09-01T00:40:26,303 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml' 2026-09-01T00:40:26,304 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml' 2026-09-01T00:40:26,306 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml' 2026-09-01T00:40:26,307 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml' 2026-09-01T00:40:26,308 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml' 2026-09-01T00:40:26,310 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml' 2026-09-01T00:40:26,311 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml' 2026-09-01T00:40:26,312 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml' 2026-09-01T00:40:26,313 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml' 2026-09-01T00:40:26,315 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml' 2026-09-01T00:40:26,316 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml' 2026-09-01T00:40:26,317 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,318 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,320 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml' 2026-09-01T00:40:26,321 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml' 2026-09-01T00:40:26,322 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml' 2026-09-01T00:40:26,324 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml' 2026-09-01T00:40:26,325 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml' 2026-09-01T00:40:26,326 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml' 2026-09-01T00:40:26,328 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml' 2026-09-01T00:40:26,329 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml' 2026-09-01T00:40:26,330 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml' 2026-09-01T00:40:26,332 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml' 2026-09-01T00:40:26,333 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml' 2026-09-01T00:40:26,334 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml' 2026-09-01T00:40:26,336 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml' 2026-09-01T00:40:26,337 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml' 2026-09-01T00:40:26,338 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml' 2026-09-01T00:40:26,340 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml' 2026-09-01T00:40:26,341 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml' 2026-09-01T00:40:26,343 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml' 2026-09-01T00:40:26,344 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml' 2026-09-01T00:40:26,346 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml' 2026-09-01T00:40:26,347 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml' 2026-09-01T00:40:26,349 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml' 2026-09-01T00:40:26,350 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml' 2026-09-01T00:40:26,351 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml' 2026-09-01T00:40:26,353 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml' 2026-09-01T00:40:26,354 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml' 2026-09-01T00:40:26,356 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml' 2026-09-01T00:40:26,357 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml' 2026-09-01T00:40:26,358 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml' 2026-09-01T00:40:26,360 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml' 2026-09-01T00:40:26,361 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml' 2026-09-01T00:40:26,362 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml' 2026-09-01T00:40:26,364 adding 'lm_eval/tasks/global_mmlu/full/sv/utils.py' 2026-09-01T00:40:26,367 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml' 2026-09-01T00:40:26,369 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml' 2026-09-01T00:40:26,370 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml' 2026-09-01T00:40:26,372 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml' 2026-09-01T00:40:26,373 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml' 2026-09-01T00:40:26,375 adding 'lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml' 2026-09-01T00:40:26,376 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml' 2026-09-01T00:40:26,378 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml' 2026-09-01T00:40:26,380 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml' 2026-09-01T00:40:26,382 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml' 2026-09-01T00:40:26,383 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml' 2026-09-01T00:40:26,385 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml' 2026-09-01T00:40:26,387 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml' 2026-09-01T00:40:26,390 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml' 2026-09-01T00:40:26,392 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml' 2026-09-01T00:40:26,395 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml' 2026-09-01T00:40:26,397 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml' 2026-09-01T00:40:26,400 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml' 2026-09-01T00:40:26,402 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml' 2026-09-01T00:40:26,405 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml' 2026-09-01T00:40:26,407 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml' 2026-09-01T00:40:26,410 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml' 2026-09-01T00:40:26,412 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml' 2026-09-01T00:40:26,414 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml' 2026-09-01T00:40:26,416 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml' 2026-09-01T00:40:26,418 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml' 2026-09-01T00:40:26,421 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml' 2026-09-01T00:40:26,423 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml' 2026-09-01T00:40:26,425 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml' 2026-09-01T00:40:26,428 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,430 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,432 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml' 2026-09-01T00:40:26,435 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml' 2026-09-01T00:40:26,437 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml' 2026-09-01T00:40:26,439 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml' 2026-09-01T00:40:26,441 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml' 2026-09-01T00:40:26,443 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml' 2026-09-01T00:40:26,444 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml' 2026-09-01T00:40:26,446 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml' 2026-09-01T00:40:26,447 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml' 2026-09-01T00:40:26,448 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml' 2026-09-01T00:40:26,450 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml' 2026-09-01T00:40:26,451 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml' 2026-09-01T00:40:26,452 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml' 2026-09-01T00:40:26,453 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml' 2026-09-01T00:40:26,455 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml' 2026-09-01T00:40:26,461 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml' 2026-09-01T00:40:26,464 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml' 2026-09-01T00:40:26,466 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml' 2026-09-01T00:40:26,467 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml' 2026-09-01T00:40:26,468 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml' 2026-09-01T00:40:26,469 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml' 2026-09-01T00:40:26,471 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml' 2026-09-01T00:40:26,472 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml' 2026-09-01T00:40:26,473 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml' 2026-09-01T00:40:26,474 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml' 2026-09-01T00:40:26,475 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml' 2026-09-01T00:40:26,477 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml' 2026-09-01T00:40:26,478 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml' 2026-09-01T00:40:26,479 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml' 2026-09-01T00:40:26,480 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml' 2026-09-01T00:40:26,481 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml' 2026-09-01T00:40:26,482 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml' 2026-09-01T00:40:26,484 adding 'lm_eval/tasks/global_mmlu/full/sw/utils.py' 2026-09-01T00:40:26,487 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml' 2026-09-01T00:40:26,488 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml' 2026-09-01T00:40:26,489 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml' 2026-09-01T00:40:26,491 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml' 2026-09-01T00:40:26,492 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml' 2026-09-01T00:40:26,493 adding 'lm_eval/tasks/global_mmlu/full/te/_te_template_yaml' 2026-09-01T00:40:26,494 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml' 2026-09-01T00:40:26,496 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml' 2026-09-01T00:40:26,497 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml' 2026-09-01T00:40:26,498 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml' 2026-09-01T00:40:26,499 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml' 2026-09-01T00:40:26,500 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml' 2026-09-01T00:40:26,501 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml' 2026-09-01T00:40:26,502 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml' 2026-09-01T00:40:26,503 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml' 2026-09-01T00:40:26,504 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml' 2026-09-01T00:40:26,506 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml' 2026-09-01T00:40:26,507 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml' 2026-09-01T00:40:26,508 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml' 2026-09-01T00:40:26,509 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml' 2026-09-01T00:40:26,510 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml' 2026-09-01T00:40:26,511 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml' 2026-09-01T00:40:26,513 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml' 2026-09-01T00:40:26,514 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml' 2026-09-01T00:40:26,515 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml' 2026-09-01T00:40:26,516 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml' 2026-09-01T00:40:26,517 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml' 2026-09-01T00:40:26,518 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml' 2026-09-01T00:40:26,520 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml' 2026-09-01T00:40:26,521 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,522 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,523 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml' 2026-09-01T00:40:26,524 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml' 2026-09-01T00:40:26,526 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml' 2026-09-01T00:40:26,527 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml' 2026-09-01T00:40:26,528 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml' 2026-09-01T00:40:26,529 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml' 2026-09-01T00:40:26,530 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml' 2026-09-01T00:40:26,532 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml' 2026-09-01T00:40:26,533 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml' 2026-09-01T00:40:26,534 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml' 2026-09-01T00:40:26,535 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml' 2026-09-01T00:40:26,537 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml' 2026-09-01T00:40:26,538 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml' 2026-09-01T00:40:26,539 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml' 2026-09-01T00:40:26,540 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml' 2026-09-01T00:40:26,541 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml' 2026-09-01T00:40:26,542 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml' 2026-09-01T00:40:26,543 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml' 2026-09-01T00:40:26,544 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml' 2026-09-01T00:40:26,546 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml' 2026-09-01T00:40:26,547 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml' 2026-09-01T00:40:26,548 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml' 2026-09-01T00:40:26,549 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml' 2026-09-01T00:40:26,550 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml' 2026-09-01T00:40:26,551 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml' 2026-09-01T00:40:26,552 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml' 2026-09-01T00:40:26,553 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml' 2026-09-01T00:40:26,554 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml' 2026-09-01T00:40:26,556 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml' 2026-09-01T00:40:26,557 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml' 2026-09-01T00:40:26,558 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml' 2026-09-01T00:40:26,559 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml' 2026-09-01T00:40:26,560 adding 'lm_eval/tasks/global_mmlu/full/te/utils.py' 2026-09-01T00:40:26,564 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml' 2026-09-01T00:40:26,565 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml' 2026-09-01T00:40:26,566 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml' 2026-09-01T00:40:26,567 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml' 2026-09-01T00:40:26,568 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml' 2026-09-01T00:40:26,570 adding 'lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml' 2026-09-01T00:40:26,571 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml' 2026-09-01T00:40:26,572 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml' 2026-09-01T00:40:26,573 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml' 2026-09-01T00:40:26,574 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml' 2026-09-01T00:40:26,576 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml' 2026-09-01T00:40:26,577 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml' 2026-09-01T00:40:26,578 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml' 2026-09-01T00:40:26,579 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml' 2026-09-01T00:40:26,581 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml' 2026-09-01T00:40:26,582 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml' 2026-09-01T00:40:26,583 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml' 2026-09-01T00:40:26,584 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml' 2026-09-01T00:40:26,585 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml' 2026-09-01T00:40:26,587 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml' 2026-09-01T00:40:26,588 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml' 2026-09-01T00:40:26,589 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml' 2026-09-01T00:40:26,590 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml' 2026-09-01T00:40:26,591 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml' 2026-09-01T00:40:26,592 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml' 2026-09-01T00:40:26,593 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml' 2026-09-01T00:40:26,594 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml' 2026-09-01T00:40:26,595 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml' 2026-09-01T00:40:26,596 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml' 2026-09-01T00:40:26,598 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,599 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,600 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml' 2026-09-01T00:40:26,601 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml' 2026-09-01T00:40:26,602 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml' 2026-09-01T00:40:26,603 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml' 2026-09-01T00:40:26,605 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml' 2026-09-01T00:40:26,606 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml' 2026-09-01T00:40:26,607 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml' 2026-09-01T00:40:26,608 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml' 2026-09-01T00:40:26,609 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml' 2026-09-01T00:40:26,611 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml' 2026-09-01T00:40:26,612 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml' 2026-09-01T00:40:26,613 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml' 2026-09-01T00:40:26,614 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml' 2026-09-01T00:40:26,616 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml' 2026-09-01T00:40:26,617 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml' 2026-09-01T00:40:26,618 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml' 2026-09-01T00:40:26,619 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml' 2026-09-01T00:40:26,620 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml' 2026-09-01T00:40:26,622 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml' 2026-09-01T00:40:26,623 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml' 2026-09-01T00:40:26,624 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml' 2026-09-01T00:40:26,625 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml' 2026-09-01T00:40:26,626 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml' 2026-09-01T00:40:26,628 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml' 2026-09-01T00:40:26,629 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml' 2026-09-01T00:40:26,630 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml' 2026-09-01T00:40:26,631 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml' 2026-09-01T00:40:26,632 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml' 2026-09-01T00:40:26,633 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml' 2026-09-01T00:40:26,635 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml' 2026-09-01T00:40:26,636 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml' 2026-09-01T00:40:26,637 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml' 2026-09-01T00:40:26,638 adding 'lm_eval/tasks/global_mmlu/full/tr/utils.py' 2026-09-01T00:40:26,641 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml' 2026-09-01T00:40:26,643 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml' 2026-09-01T00:40:26,644 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml' 2026-09-01T00:40:26,645 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml' 2026-09-01T00:40:26,646 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml' 2026-09-01T00:40:26,647 adding 'lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml' 2026-09-01T00:40:26,649 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml' 2026-09-01T00:40:26,650 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml' 2026-09-01T00:40:26,651 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml' 2026-09-01T00:40:26,652 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml' 2026-09-01T00:40:26,653 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml' 2026-09-01T00:40:26,654 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml' 2026-09-01T00:40:26,656 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml' 2026-09-01T00:40:26,657 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml' 2026-09-01T00:40:26,658 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml' 2026-09-01T00:40:26,659 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml' 2026-09-01T00:40:26,660 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml' 2026-09-01T00:40:26,662 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml' 2026-09-01T00:40:26,663 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml' 2026-09-01T00:40:26,664 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml' 2026-09-01T00:40:26,665 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml' 2026-09-01T00:40:26,666 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml' 2026-09-01T00:40:26,667 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml' 2026-09-01T00:40:26,669 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml' 2026-09-01T00:40:26,670 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml' 2026-09-01T00:40:26,671 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml' 2026-09-01T00:40:26,672 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml' 2026-09-01T00:40:26,674 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml' 2026-09-01T00:40:26,675 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml' 2026-09-01T00:40:26,676 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,677 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,678 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml' 2026-09-01T00:40:26,680 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml' 2026-09-01T00:40:26,681 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml' 2026-09-01T00:40:26,683 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml' 2026-09-01T00:40:26,684 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml' 2026-09-01T00:40:26,686 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml' 2026-09-01T00:40:26,687 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml' 2026-09-01T00:40:26,688 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml' 2026-09-01T00:40:26,690 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml' 2026-09-01T00:40:26,691 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml' 2026-09-01T00:40:26,692 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml' 2026-09-01T00:40:26,693 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml' 2026-09-01T00:40:26,694 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml' 2026-09-01T00:40:26,695 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml' 2026-09-01T00:40:26,696 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml' 2026-09-01T00:40:26,698 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml' 2026-09-01T00:40:26,699 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml' 2026-09-01T00:40:26,700 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml' 2026-09-01T00:40:26,701 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml' 2026-09-01T00:40:26,702 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml' 2026-09-01T00:40:26,703 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml' 2026-09-01T00:40:26,705 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml' 2026-09-01T00:40:26,706 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml' 2026-09-01T00:40:26,707 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml' 2026-09-01T00:40:26,708 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml' 2026-09-01T00:40:26,709 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml' 2026-09-01T00:40:26,710 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml' 2026-09-01T00:40:26,711 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml' 2026-09-01T00:40:26,713 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml' 2026-09-01T00:40:26,714 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml' 2026-09-01T00:40:26,715 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml' 2026-09-01T00:40:26,716 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml' 2026-09-01T00:40:26,718 adding 'lm_eval/tasks/global_mmlu/full/uk/utils.py' 2026-09-01T00:40:26,721 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml' 2026-09-01T00:40:26,722 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml' 2026-09-01T00:40:26,723 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml' 2026-09-01T00:40:26,724 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml' 2026-09-01T00:40:26,725 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml' 2026-09-01T00:40:26,726 adding 'lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml' 2026-09-01T00:40:26,728 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml' 2026-09-01T00:40:26,729 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml' 2026-09-01T00:40:26,730 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml' 2026-09-01T00:40:26,731 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml' 2026-09-01T00:40:26,732 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml' 2026-09-01T00:40:26,733 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml' 2026-09-01T00:40:26,734 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml' 2026-09-01T00:40:26,735 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml' 2026-09-01T00:40:26,737 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml' 2026-09-01T00:40:26,738 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml' 2026-09-01T00:40:26,739 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml' 2026-09-01T00:40:26,740 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml' 2026-09-01T00:40:26,741 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml' 2026-09-01T00:40:26,742 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml' 2026-09-01T00:40:26,744 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml' 2026-09-01T00:40:26,745 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml' 2026-09-01T00:40:26,746 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml' 2026-09-01T00:40:26,747 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml' 2026-09-01T00:40:26,749 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml' 2026-09-01T00:40:26,750 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml' 2026-09-01T00:40:26,751 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml' 2026-09-01T00:40:26,753 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml' 2026-09-01T00:40:26,754 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml' 2026-09-01T00:40:26,755 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,756 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,758 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml' 2026-09-01T00:40:26,759 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml' 2026-09-01T00:40:26,760 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml' 2026-09-01T00:40:26,761 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml' 2026-09-01T00:40:26,762 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml' 2026-09-01T00:40:26,764 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml' 2026-09-01T00:40:26,765 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml' 2026-09-01T00:40:26,766 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml' 2026-09-01T00:40:26,767 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml' 2026-09-01T00:40:26,768 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml' 2026-09-01T00:40:26,770 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml' 2026-09-01T00:40:26,771 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml' 2026-09-01T00:40:26,772 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml' 2026-09-01T00:40:26,773 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml' 2026-09-01T00:40:26,774 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml' 2026-09-01T00:40:26,776 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml' 2026-09-01T00:40:26,777 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml' 2026-09-01T00:40:26,778 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml' 2026-09-01T00:40:26,779 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml' 2026-09-01T00:40:26,780 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml' 2026-09-01T00:40:26,781 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml' 2026-09-01T00:40:26,782 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml' 2026-09-01T00:40:26,784 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml' 2026-09-01T00:40:26,785 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml' 2026-09-01T00:40:26,786 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml' 2026-09-01T00:40:26,787 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml' 2026-09-01T00:40:26,788 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml' 2026-09-01T00:40:26,790 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml' 2026-09-01T00:40:26,791 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml' 2026-09-01T00:40:26,792 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml' 2026-09-01T00:40:26,793 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml' 2026-09-01T00:40:26,794 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml' 2026-09-01T00:40:26,796 adding 'lm_eval/tasks/global_mmlu/full/vi/utils.py' 2026-09-01T00:40:26,799 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml' 2026-09-01T00:40:26,800 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml' 2026-09-01T00:40:26,801 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml' 2026-09-01T00:40:26,802 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml' 2026-09-01T00:40:26,804 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml' 2026-09-01T00:40:26,805 adding 'lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml' 2026-09-01T00:40:26,806 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml' 2026-09-01T00:40:26,807 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml' 2026-09-01T00:40:26,809 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml' 2026-09-01T00:40:26,810 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml' 2026-09-01T00:40:26,811 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml' 2026-09-01T00:40:26,812 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml' 2026-09-01T00:40:26,814 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml' 2026-09-01T00:40:26,815 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml' 2026-09-01T00:40:26,816 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml' 2026-09-01T00:40:26,817 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml' 2026-09-01T00:40:26,818 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml' 2026-09-01T00:40:26,819 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml' 2026-09-01T00:40:26,820 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml' 2026-09-01T00:40:26,822 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml' 2026-09-01T00:40:26,823 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml' 2026-09-01T00:40:26,824 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml' 2026-09-01T00:40:26,825 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml' 2026-09-01T00:40:26,826 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml' 2026-09-01T00:40:26,828 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml' 2026-09-01T00:40:26,829 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml' 2026-09-01T00:40:26,830 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml' 2026-09-01T00:40:26,831 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml' 2026-09-01T00:40:26,832 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml' 2026-09-01T00:40:26,833 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,834 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,836 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml' 2026-09-01T00:40:26,837 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml' 2026-09-01T00:40:26,838 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml' 2026-09-01T00:40:26,839 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml' 2026-09-01T00:40:26,841 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml' 2026-09-01T00:40:26,842 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml' 2026-09-01T00:40:26,843 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml' 2026-09-01T00:40:26,844 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml' 2026-09-01T00:40:26,846 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml' 2026-09-01T00:40:26,847 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml' 2026-09-01T00:40:26,848 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml' 2026-09-01T00:40:26,849 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml' 2026-09-01T00:40:26,851 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml' 2026-09-01T00:40:26,852 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml' 2026-09-01T00:40:26,853 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml' 2026-09-01T00:40:26,854 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml' 2026-09-01T00:40:26,855 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml' 2026-09-01T00:40:26,857 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml' 2026-09-01T00:40:26,858 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml' 2026-09-01T00:40:26,859 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml' 2026-09-01T00:40:26,860 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml' 2026-09-01T00:40:26,861 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml' 2026-09-01T00:40:26,862 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml' 2026-09-01T00:40:26,863 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml' 2026-09-01T00:40:26,865 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml' 2026-09-01T00:40:26,866 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml' 2026-09-01T00:40:26,867 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml' 2026-09-01T00:40:26,868 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml' 2026-09-01T00:40:26,870 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml' 2026-09-01T00:40:26,871 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml' 2026-09-01T00:40:26,872 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml' 2026-09-01T00:40:26,873 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml' 2026-09-01T00:40:26,874 adding 'lm_eval/tasks/global_mmlu/full/yo/utils.py' 2026-09-01T00:40:26,877 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml' 2026-09-01T00:40:26,879 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml' 2026-09-01T00:40:26,880 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml' 2026-09-01T00:40:26,881 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml' 2026-09-01T00:40:26,882 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml' 2026-09-01T00:40:26,883 adding 'lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml' 2026-09-01T00:40:26,885 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml' 2026-09-01T00:40:26,886 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml' 2026-09-01T00:40:26,887 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml' 2026-09-01T00:40:26,888 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml' 2026-09-01T00:40:26,889 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml' 2026-09-01T00:40:26,891 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml' 2026-09-01T00:40:26,892 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml' 2026-09-01T00:40:26,893 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml' 2026-09-01T00:40:26,894 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml' 2026-09-01T00:40:26,895 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml' 2026-09-01T00:40:26,897 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml' 2026-09-01T00:40:26,898 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml' 2026-09-01T00:40:26,899 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml' 2026-09-01T00:40:26,900 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml' 2026-09-01T00:40:26,902 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml' 2026-09-01T00:40:26,903 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml' 2026-09-01T00:40:26,904 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml' 2026-09-01T00:40:26,905 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml' 2026-09-01T00:40:26,906 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml' 2026-09-01T00:40:26,908 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml' 2026-09-01T00:40:26,909 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml' 2026-09-01T00:40:26,910 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml' 2026-09-01T00:40:26,911 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml' 2026-09-01T00:40:26,912 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml' 2026-09-01T00:40:26,913 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml' 2026-09-01T00:40:26,914 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml' 2026-09-01T00:40:26,916 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml' 2026-09-01T00:40:26,917 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml' 2026-09-01T00:40:26,918 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml' 2026-09-01T00:40:26,919 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml' 2026-09-01T00:40:26,920 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml' 2026-09-01T00:40:26,922 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml' 2026-09-01T00:40:26,923 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml' 2026-09-01T00:40:26,924 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml' 2026-09-01T00:40:26,925 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml' 2026-09-01T00:40:26,926 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml' 2026-09-01T00:40:26,927 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml' 2026-09-01T00:40:26,929 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml' 2026-09-01T00:40:26,930 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml' 2026-09-01T00:40:26,931 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml' 2026-09-01T00:40:26,932 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml' 2026-09-01T00:40:26,933 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml' 2026-09-01T00:40:26,934 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml' 2026-09-01T00:40:26,936 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml' 2026-09-01T00:40:26,937 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml' 2026-09-01T00:40:26,938 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml' 2026-09-01T00:40:26,939 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml' 2026-09-01T00:40:26,940 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml' 2026-09-01T00:40:26,942 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml' 2026-09-01T00:40:26,943 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml' 2026-09-01T00:40:26,944 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml' 2026-09-01T00:40:26,945 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml' 2026-09-01T00:40:26,946 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml' 2026-09-01T00:40:26,947 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml' 2026-09-01T00:40:26,948 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml' 2026-09-01T00:40:26,949 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml' 2026-09-01T00:40:26,951 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml' 2026-09-01T00:40:26,952 adding 'lm_eval/tasks/global_mmlu/full/zh/utils.py' 2026-09-01T00:40:26,955 adding 'lm_eval/tasks/global_piqa/README.md' 2026-09-01T00:40:26,956 adding 'lm_eval/tasks/global_piqa/_global_piqa_cloze.yaml' 2026-09-01T00:40:26,957 adding 'lm_eval/tasks/global_piqa/_global_piqa_generation.yaml' 2026-09-01T00:40:26,962 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/_generate_config.py' 2026-09-01T00:40:26,963 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/_global_piqa_nonparallel_cloze.yaml' 2026-09-01T00:40:26,964 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/_template' 2026-09-01T00:40:26,965 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/acm_arab.yaml' 2026-09-01T00:40:26,967 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/acq_arab.yaml' 2026-09-01T00:40:26,968 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/aeb_arab.yaml' 2026-09-01T00:40:26,969 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/afb_arab.yaml' 2026-09-01T00:40:26,970 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/als_latn.yaml' 2026-09-01T00:40:26,971 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/amh_ethi.yaml' 2026-09-01T00:40:26,972 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_jord.yaml' 2026-09-01T00:40:26,973 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_leba.yaml' 2026-09-01T00:40:26,975 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_pale.yaml' 2026-09-01T00:40:26,976 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_syri.yaml' 2026-09-01T00:40:26,977 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/arb_arab.yaml' 2026-09-01T00:40:26,978 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/arq_arab.yaml' 2026-09-01T00:40:26,979 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ars_arab.yaml' 2026-09-01T00:40:26,980 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ary_arab.yaml' 2026-09-01T00:40:26,982 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/arz_arab.yaml' 2026-09-01T00:40:26,983 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/asm_beng.yaml' 2026-09-01T00:40:26,984 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/azj_latn.yaml' 2026-09-01T00:40:26,985 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bam_latn.yaml' 2026-09-01T00:40:26,986 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bcc_arab.yaml' 2026-09-01T00:40:26,987 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bel_cyrl.yaml' 2026-09-01T00:40:26,989 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ben_beng.yaml' 2026-09-01T00:40:26,990 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ben_latn.yaml' 2026-09-01T00:40:26,991 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bgc_deva.yaml' 2026-09-01T00:40:26,992 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bho_deva.yaml' 2026-09-01T00:40:26,993 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bos_latn.yaml' 2026-09-01T00:40:26,994 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bra_deva.yaml' 2026-09-01T00:40:26,996 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bsk_arab.yaml' 2026-09-01T00:40:26,997 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/btx_latn.yaml' 2026-09-01T00:40:26,998 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bul_cyrl.yaml' 2026-09-01T00:40:26,999 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/cat_latn.yaml' 2026-09-01T00:40:27,000 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ces_latn.yaml' 2026-09-01T00:40:27,001 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ckb_arab.yaml' 2026-09-01T00:40:27,002 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ckm_latn.yaml' 2026-09-01T00:40:27,003 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/cls_deva.yaml' 2026-09-01T00:40:27,004 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hans.yaml' 2026-09-01T00:40:27,006 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hant.yaml' 2026-09-01T00:40:27,007 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/dan_latn.yaml' 2026-09-01T00:40:27,008 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/deu_latn.yaml' 2026-09-01T00:40:27,009 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/dhd_deva.yaml' 2026-09-01T00:40:27,010 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/dje_latn.yaml' 2026-09-01T00:40:27,011 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ekk_latn.yaml' 2026-09-01T00:40:27,012 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ekp_latn.yaml' 2026-09-01T00:40:27,014 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ell_grek.yaml' 2026-09-01T00:40:27,015 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/eng_latn.yaml' 2026-09-01T00:40:27,016 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/eus_latn.yaml' 2026-09-01T00:40:27,017 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/fao_latn.yaml' 2026-09-01T00:40:27,018 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/fin_latn.yaml' 2026-09-01T00:40:27,019 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_cana.yaml' 2026-09-01T00:40:27,020 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_fran.yaml' 2026-09-01T00:40:27,021 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/glg_latn.yaml' 2026-09-01T00:40:27,023 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/guj_gujr.yaml' 2026-09-01T00:40:27,024 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hau_latn.yaml' 2026-09-01T00:40:27,025 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/haw_latn.yaml' 2026-09-01T00:40:27,026 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/heb_hebr.yaml' 2026-09-01T00:40:27,027 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hin_deva.yaml' 2026-09-01T00:40:27,028 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hin_latn.yaml' 2026-09-01T00:40:27,030 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hrv_latn.yaml' 2026-09-01T00:40:27,031 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hun_latn.yaml' 2026-09-01T00:40:27,032 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hye_armn.yaml' 2026-09-01T00:40:27,033 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ibo_latn.yaml' 2026-09-01T00:40:27,034 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/idu_latn.yaml' 2026-09-01T00:40:27,035 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ind_latn.yaml' 2026-09-01T00:40:27,037 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/isl_latn.yaml' 2026-09-01T00:40:27,038 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/iso_latn.yaml' 2026-09-01T00:40:27,039 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ita_latn.yaml' 2026-09-01T00:40:27,040 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/jav_latn.yaml' 2026-09-01T00:40:27,041 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/jpn_jpan.yaml' 2026-09-01T00:40:27,042 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kan_knda.yaml' 2026-09-01T00:40:27,044 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kan_latn.yaml' 2026-09-01T00:40:27,045 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kat_geor.yaml' 2026-09-01T00:40:27,046 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kaz_cyrl.yaml' 2026-09-01T00:40:27,047 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kin_latn.yaml' 2026-09-01T00:40:27,048 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kir_cyrl.yaml' 2026-09-01T00:40:27,050 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kor_hang.yaml' 2026-09-01T00:40:27,051 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/lin_latn.yaml' 2026-09-01T00:40:27,052 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/lit_latn.yaml' 2026-09-01T00:40:27,053 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/luo_latn.yaml' 2026-09-01T00:40:27,054 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mal_mlym.yaml' 2026-09-01T00:40:27,055 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mar_deva.yaml' 2026-09-01T00:40:27,056 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mkd_cyrl.yaml' 2026-09-01T00:40:27,057 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mni_beng.yaml' 2026-09-01T00:40:27,059 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mni_mtei.yaml' 2026-09-01T00:40:27,060 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/nag_latn.yaml' 2026-09-01T00:40:27,061 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/nld_latn.yaml' 2026-09-01T00:40:27,062 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/nno_latn.yaml' 2026-09-01T00:40:27,063 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/nob_latn.yaml' 2026-09-01T00:40:27,064 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/npi_deva.yaml' 2026-09-01T00:40:27,065 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ory_orya.yaml' 2026-09-01T00:40:27,067 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/pan_guru.yaml' 2026-09-01T00:40:27,068 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/pcm_latn.yaml' 2026-09-01T00:40:27,069 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/pes_arab.yaml' 2026-09-01T00:40:27,070 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/plt_latn.yaml' 2026-09-01T00:40:27,071 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/pol_latn.yaml' 2026-09-01T00:40:27,072 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_braz.yaml' 2026-09-01T00:40:27,073 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_port.yaml' 2026-09-01T00:40:27,075 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ron_latn.yaml' 2026-09-01T00:40:27,076 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/rus_cyrl.yaml' 2026-09-01T00:40:27,077 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/rwr_deva.yaml' 2026-09-01T00:40:27,078 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/sin_latn.yaml' 2026-09-01T00:40:27,079 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/sin_sinh.yaml' 2026-09-01T00:40:27,081 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn.yaml' 2026-09-01T00:40:27,082 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn_sari.yaml' 2026-09-01T00:40:27,083 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn.yaml' 2026-09-01T00:40:27,084 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_cerk.yaml' 2026-09-01T00:40:27,085 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_prle.yaml' 2026-09-01T00:40:27,086 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/snd_arab.yaml' 2026-09-01T00:40:27,087 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/snd_deva.yaml' 2026-09-01T00:40:27,089 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_mexi.yaml' 2026-09-01T00:40:27,090 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_peru.yaml' 2026-09-01T00:40:27,091 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_spai.yaml' 2026-09-01T00:40:27,092 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl.yaml' 2026-09-01T00:40:27,093 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl_torl.yaml' 2026-09-01T00:40:27,094 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn.yaml' 2026-09-01T00:40:27,096 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn_torl.yaml' 2026-09-01T00:40:27,097 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/sun_latn.yaml' 2026-09-01T00:40:27,098 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/swe_latn.yaml' 2026-09-01T00:40:27,099 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/swh_latn.yaml' 2026-09-01T00:40:27,101 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/swv_deva.yaml' 2026-09-01T00:40:27,102 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tam_latn.yaml' 2026-09-01T00:40:27,103 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tam_taml.yaml' 2026-09-01T00:40:27,104 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tel_latn.yaml' 2026-09-01T00:40:27,105 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tel_telu.yaml' 2026-09-01T00:40:27,106 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tgl_latn.yaml' 2026-09-01T00:40:27,107 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tha_thai.yaml' 2026-09-01T00:40:27,108 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tur_latn.yaml' 2026-09-01T00:40:27,109 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/uig_arab.yaml' 2026-09-01T00:40:27,110 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ukr_cyrl.yaml' 2026-09-01T00:40:27,112 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/urd_arab.yaml' 2026-09-01T00:40:27,113 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/urd_latn.yaml' 2026-09-01T00:40:27,114 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/urh_latn.yaml' 2026-09-01T00:40:27,115 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/uzn_latn.yaml' 2026-09-01T00:40:27,116 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/vie_latn.yaml' 2026-09-01T00:40:27,117 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/yor_latn.yaml' 2026-09-01T00:40:27,119 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/yue_hant.yaml' 2026-09-01T00:40:27,120 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/zsm_latn.yaml' 2026-09-01T00:40:27,121 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/zul_latn.yaml' 2026-09-01T00:40:27,125 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/_generate_config.py' 2026-09-01T00:40:27,127 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/_global_piqa_nonparallel_generation.yaml' 2026-09-01T00:40:27,128 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/_template' 2026-09-01T00:40:27,130 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/acm_arab.yaml' 2026-09-01T00:40:27,131 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/acq_arab.yaml' 2026-09-01T00:40:27,132 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/aeb_arab.yaml' 2026-09-01T00:40:27,133 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/afb_arab.yaml' 2026-09-01T00:40:27,134 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/als_latn.yaml' 2026-09-01T00:40:27,135 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/amh_ethi.yaml' 2026-09-01T00:40:27,137 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_jord.yaml' 2026-09-01T00:40:27,138 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_leba.yaml' 2026-09-01T00:40:27,139 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_pale.yaml' 2026-09-01T00:40:27,140 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_syri.yaml' 2026-09-01T00:40:27,141 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/arb_arab.yaml' 2026-09-01T00:40:27,142 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/arq_arab.yaml' 2026-09-01T00:40:27,143 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ars_arab.yaml' 2026-09-01T00:40:27,144 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ary_arab.yaml' 2026-09-01T00:40:27,146 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/arz_arab.yaml' 2026-09-01T00:40:27,147 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/asm_beng.yaml' 2026-09-01T00:40:27,148 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/azj_latn.yaml' 2026-09-01T00:40:27,149 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bam_latn.yaml' 2026-09-01T00:40:27,151 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bcc_arab.yaml' 2026-09-01T00:40:27,152 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bel_cyrl.yaml' 2026-09-01T00:40:27,153 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ben_beng.yaml' 2026-09-01T00:40:27,154 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ben_latn.yaml' 2026-09-01T00:40:27,155 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bgc_deva.yaml' 2026-09-01T00:40:27,156 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bho_deva.yaml' 2026-09-01T00:40:27,157 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bos_latn.yaml' 2026-09-01T00:40:27,158 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bra_deva.yaml' 2026-09-01T00:40:27,160 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bsk_arab.yaml' 2026-09-01T00:40:27,161 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/btx_latn.yaml' 2026-09-01T00:40:27,162 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bul_cyrl.yaml' 2026-09-01T00:40:27,163 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/cat_latn.yaml' 2026-09-01T00:40:27,164 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ces_latn.yaml' 2026-09-01T00:40:27,165 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ckb_arab.yaml' 2026-09-01T00:40:27,167 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ckm_latn.yaml' 2026-09-01T00:40:27,168 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/cls_deva.yaml' 2026-09-01T00:40:27,169 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hans.yaml' 2026-09-01T00:40:27,170 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hant.yaml' 2026-09-01T00:40:27,171 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/dan_latn.yaml' 2026-09-01T00:40:27,172 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/deu_latn.yaml' 2026-09-01T00:40:27,173 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/dhd_deva.yaml' 2026-09-01T00:40:27,175 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/dje_latn.yaml' 2026-09-01T00:40:27,176 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ekk_latn.yaml' 2026-09-01T00:40:27,177 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ekp_latn.yaml' 2026-09-01T00:40:27,178 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ell_grek.yaml' 2026-09-01T00:40:27,180 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/eng_latn.yaml' 2026-09-01T00:40:27,181 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/eus_latn.yaml' 2026-09-01T00:40:27,182 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/fao_latn.yaml' 2026-09-01T00:40:27,183 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/fin_latn.yaml' 2026-09-01T00:40:27,184 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_cana.yaml' 2026-09-01T00:40:27,186 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_fran.yaml' 2026-09-01T00:40:27,187 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/glg_latn.yaml' 2026-09-01T00:40:27,188 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/guj_gujr.yaml' 2026-09-01T00:40:27,189 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hau_latn.yaml' 2026-09-01T00:40:27,190 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/haw_latn.yaml' 2026-09-01T00:40:27,191 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/heb_hebr.yaml' 2026-09-01T00:40:27,193 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hin_deva.yaml' 2026-09-01T00:40:27,194 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hin_latn.yaml' 2026-09-01T00:40:27,195 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hrv_latn.yaml' 2026-09-01T00:40:27,196 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hun_latn.yaml' 2026-09-01T00:40:27,197 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hye_armn.yaml' 2026-09-01T00:40:27,199 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ibo_latn.yaml' 2026-09-01T00:40:27,200 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/idu_latn.yaml' 2026-09-01T00:40:27,201 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ind_latn.yaml' 2026-09-01T00:40:27,202 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/isl_latn.yaml' 2026-09-01T00:40:27,203 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/iso_latn.yaml' 2026-09-01T00:40:27,204 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ita_latn.yaml' 2026-09-01T00:40:27,205 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/jav_latn.yaml' 2026-09-01T00:40:27,206 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/jpn_jpan.yaml' 2026-09-01T00:40:27,208 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kan_knda.yaml' 2026-09-01T00:40:27,209 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kan_latn.yaml' 2026-09-01T00:40:27,210 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kat_geor.yaml' 2026-09-01T00:40:27,211 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kaz_cyrl.yaml' 2026-09-01T00:40:27,212 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kin_latn.yaml' 2026-09-01T00:40:27,213 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kir_cyrl.yaml' 2026-09-01T00:40:27,214 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kor_hang.yaml' 2026-09-01T00:40:27,215 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/lin_latn.yaml' 2026-09-01T00:40:27,217 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/lit_latn.yaml' 2026-09-01T00:40:27,218 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/luo_latn.yaml' 2026-09-01T00:40:27,219 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mal_mlym.yaml' 2026-09-01T00:40:27,220 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mar_deva.yaml' 2026-09-01T00:40:27,221 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mkd_cyrl.yaml' 2026-09-01T00:40:27,222 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mni_beng.yaml' 2026-09-01T00:40:27,223 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mni_mtei.yaml' 2026-09-01T00:40:27,224 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/nag_latn.yaml' 2026-09-01T00:40:27,226 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/nld_latn.yaml' 2026-09-01T00:40:27,227 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/nno_latn.yaml' 2026-09-01T00:40:27,228 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/nob_latn.yaml' 2026-09-01T00:40:27,229 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/npi_deva.yaml' 2026-09-01T00:40:27,230 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ory_orya.yaml' 2026-09-01T00:40:27,231 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/pan_guru.yaml' 2026-09-01T00:40:27,233 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/pcm_latn.yaml' 2026-09-01T00:40:27,234 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/pes_arab.yaml' 2026-09-01T00:40:27,235 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/plt_latn.yaml' 2026-09-01T00:40:27,236 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/pol_latn.yaml' 2026-09-01T00:40:27,238 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_braz.yaml' 2026-09-01T00:40:27,239 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_port.yaml' 2026-09-01T00:40:27,240 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ron_latn.yaml' 2026-09-01T00:40:27,241 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/rus_cyrl.yaml' 2026-09-01T00:40:27,242 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/rwr_deva.yaml' 2026-09-01T00:40:27,243 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/sin_latn.yaml' 2026-09-01T00:40:27,245 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/sin_sinh.yaml' 2026-09-01T00:40:27,246 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn.yaml' 2026-09-01T00:40:27,247 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn_sari.yaml' 2026-09-01T00:40:27,248 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn.yaml' 2026-09-01T00:40:27,249 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_cerk.yaml' 2026-09-01T00:40:27,250 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_prle.yaml' 2026-09-01T00:40:27,251 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/snd_arab.yaml' 2026-09-01T00:40:27,253 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/snd_deva.yaml' 2026-09-01T00:40:27,254 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_mexi.yaml' 2026-09-01T00:40:27,255 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_peru.yaml' 2026-09-01T00:40:27,256 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_spai.yaml' 2026-09-01T00:40:27,257 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl.yaml' 2026-09-01T00:40:27,258 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl_torl.yaml' 2026-09-01T00:40:27,259 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn.yaml' 2026-09-01T00:40:27,260 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn_torl.yaml' 2026-09-01T00:40:27,261 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/sun_latn.yaml' 2026-09-01T00:40:27,262 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/swe_latn.yaml' 2026-09-01T00:40:27,263 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/swh_latn.yaml' 2026-09-01T00:40:27,264 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/swv_deva.yaml' 2026-09-01T00:40:27,266 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tam_latn.yaml' 2026-09-01T00:40:27,267 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tam_taml.yaml' 2026-09-01T00:40:27,268 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tel_latn.yaml' 2026-09-01T00:40:27,269 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tel_telu.yaml' 2026-09-01T00:40:27,270 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tgl_latn.yaml' 2026-09-01T00:40:27,271 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tha_thai.yaml' 2026-09-01T00:40:27,272 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tur_latn.yaml' 2026-09-01T00:40:27,273 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/uig_arab.yaml' 2026-09-01T00:40:27,275 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ukr_cyrl.yaml' 2026-09-01T00:40:27,276 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/urd_arab.yaml' 2026-09-01T00:40:27,277 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/urd_latn.yaml' 2026-09-01T00:40:27,278 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/urh_latn.yaml' 2026-09-01T00:40:27,279 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/uzn_latn.yaml' 2026-09-01T00:40:27,281 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/vie_latn.yaml' 2026-09-01T00:40:27,282 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/yor_latn.yaml' 2026-09-01T00:40:27,283 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/yue_hant.yaml' 2026-09-01T00:40:27,284 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/zsm_latn.yaml' 2026-09-01T00:40:27,285 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/zul_latn.yaml' 2026-09-01T00:40:27,290 adding 'lm_eval/tasks/global_piqa/parallel_cloze/_generate_config.py' 2026-09-01T00:40:27,291 adding 'lm_eval/tasks/global_piqa/parallel_cloze/_global_piqa_parallel_cloze.yaml' 2026-09-01T00:40:27,293 adding 'lm_eval/tasks/global_piqa/parallel_cloze/_template' 2026-09-01T00:40:27,294 adding 'lm_eval/tasks/global_piqa/parallel_cloze/acm_arab.yaml' 2026-09-01T00:40:27,295 adding 'lm_eval/tasks/global_piqa/parallel_cloze/acq_arab.yaml' 2026-09-01T00:40:27,296 adding 'lm_eval/tasks/global_piqa/parallel_cloze/aeb_arab.yaml' 2026-09-01T00:40:27,298 adding 'lm_eval/tasks/global_piqa/parallel_cloze/afb_arab.yaml' 2026-09-01T00:40:27,299 adding 'lm_eval/tasks/global_piqa/parallel_cloze/als_latn.yaml' 2026-09-01T00:40:27,300 adding 'lm_eval/tasks/global_piqa/parallel_cloze/amh_ethi.yaml' 2026-09-01T00:40:27,301 adding 'lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_jord.yaml' 2026-09-01T00:40:27,302 adding 'lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_leba.yaml' 2026-09-01T00:40:27,303 adding 'lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_pale.yaml' 2026-09-01T00:40:27,305 adding 'lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_syri.yaml' 2026-09-01T00:40:27,306 adding 'lm_eval/tasks/global_piqa/parallel_cloze/arb_arab.yaml' 2026-09-01T00:40:27,307 adding 'lm_eval/tasks/global_piqa/parallel_cloze/arq_arab.yaml' 2026-09-01T00:40:27,308 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ars_arab.yaml' 2026-09-01T00:40:27,309 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ary_arab.yaml' 2026-09-01T00:40:27,310 adding 'lm_eval/tasks/global_piqa/parallel_cloze/arz_arab.yaml' 2026-09-01T00:40:27,311 adding 'lm_eval/tasks/global_piqa/parallel_cloze/azj_latn.yaml' 2026-09-01T00:40:27,313 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bam_latn.yaml' 2026-09-01T00:40:27,314 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bcc_arab.yaml' 2026-09-01T00:40:27,315 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bel_cyrl.yaml' 2026-09-01T00:40:27,316 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ben_beng.yaml' 2026-09-01T00:40:27,317 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ben_latn.yaml' 2026-09-01T00:40:27,319 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bgc_deva.yaml' 2026-09-01T00:40:27,320 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bho_deva.yaml' 2026-09-01T00:40:27,321 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bra_deva.yaml' 2026-09-01T00:40:27,322 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bul_cyrl.yaml' 2026-09-01T00:40:27,323 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bxr_cyrl.yaml' 2026-09-01T00:40:27,325 adding 'lm_eval/tasks/global_piqa/parallel_cloze/cat_latn.yaml' 2026-09-01T00:40:27,326 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ceb_latn.yaml' 2026-09-01T00:40:27,327 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ces_latn.yaml' 2026-09-01T00:40:27,328 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ckm_latn.yaml' 2026-09-01T00:40:27,329 adding 'lm_eval/tasks/global_piqa/parallel_cloze/cls_deva.yaml' 2026-09-01T00:40:27,330 adding 'lm_eval/tasks/global_piqa/parallel_cloze/cmn_hans.yaml' 2026-09-01T00:40:27,332 adding 'lm_eval/tasks/global_piqa/parallel_cloze/cmn_hant.yaml' 2026-09-01T00:40:27,333 adding 'lm_eval/tasks/global_piqa/parallel_cloze/dan_latn.yaml' 2026-09-01T00:40:27,334 adding 'lm_eval/tasks/global_piqa/parallel_cloze/deu_latn.yaml' 2026-09-01T00:40:27,335 adding 'lm_eval/tasks/global_piqa/parallel_cloze/dhd_deva.yaml' 2026-09-01T00:40:27,336 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ekk_latn.yaml' 2026-09-01T00:40:27,337 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ekp_latn.yaml' 2026-09-01T00:40:27,339 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ell_grek.yaml' 2026-09-01T00:40:27,340 adding 'lm_eval/tasks/global_piqa/parallel_cloze/eng_latn.yaml' 2026-09-01T00:40:27,341 adding 'lm_eval/tasks/global_piqa/parallel_cloze/eus_latn.yaml' 2026-09-01T00:40:27,342 adding 'lm_eval/tasks/global_piqa/parallel_cloze/fao_latn.yaml' 2026-09-01T00:40:27,343 adding 'lm_eval/tasks/global_piqa/parallel_cloze/fin_latn.yaml' 2026-09-01T00:40:27,344 adding 'lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_cana.yaml' 2026-09-01T00:40:27,346 adding 'lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_fran.yaml' 2026-09-01T00:40:27,347 adding 'lm_eval/tasks/global_piqa/parallel_cloze/glg_latn.yaml' 2026-09-01T00:40:27,348 adding 'lm_eval/tasks/global_piqa/parallel_cloze/guj_gujr.yaml' 2026-09-01T00:40:27,349 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hau_latn.yaml' 2026-09-01T00:40:27,350 adding 'lm_eval/tasks/global_piqa/parallel_cloze/haw_latn.yaml' 2026-09-01T00:40:27,351 adding 'lm_eval/tasks/global_piqa/parallel_cloze/heb_hebr.yaml' 2026-09-01T00:40:27,353 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hin_deva.yaml' 2026-09-01T00:40:27,354 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hin_latn.yaml' 2026-09-01T00:40:27,355 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hrv_latn.yaml' 2026-09-01T00:40:27,356 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hun_latn.yaml' 2026-09-01T00:40:27,357 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hye_armn.yaml' 2026-09-01T00:40:27,358 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ibo_latn.yaml' 2026-09-01T00:40:27,359 adding 'lm_eval/tasks/global_piqa/parallel_cloze/idu_latn.yaml' 2026-09-01T00:40:27,360 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ilo_latn.yaml' 2026-09-01T00:40:27,362 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ind_latn.yaml' 2026-09-01T00:40:27,363 adding 'lm_eval/tasks/global_piqa/parallel_cloze/isl_latn.yaml' 2026-09-01T00:40:27,364 adding 'lm_eval/tasks/global_piqa/parallel_cloze/iso_latn.yaml' 2026-09-01T00:40:27,365 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ita_latn.yaml' 2026-09-01T00:40:27,366 adding 'lm_eval/tasks/global_piqa/parallel_cloze/jav_latn.yaml' 2026-09-01T00:40:27,368 adding 'lm_eval/tasks/global_piqa/parallel_cloze/jpn_jpan.yaml' 2026-09-01T00:40:27,369 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kan_knda.yaml' 2026-09-01T00:40:27,370 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kan_latn.yaml' 2026-09-01T00:40:27,371 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kat_geor.yaml' 2026-09-01T00:40:27,372 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kin_latn.yaml' 2026-09-01T00:40:27,373 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kir_cyrl.yaml' 2026-09-01T00:40:27,375 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kor_hang.yaml' 2026-09-01T00:40:27,376 adding 'lm_eval/tasks/global_piqa/parallel_cloze/lin_latn.yaml' 2026-09-01T00:40:27,377 adding 'lm_eval/tasks/global_piqa/parallel_cloze/lit_latn.yaml' 2026-09-01T00:40:27,378 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mag_deva.yaml' 2026-09-01T00:40:27,380 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mal_mlym.yaml' 2026-09-01T00:40:27,381 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mar_deva.yaml' 2026-09-01T00:40:27,382 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mkd_cyrl.yaml' 2026-09-01T00:40:27,383 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mni_beng.yaml' 2026-09-01T00:40:27,384 adding 'lm_eval/tasks/global_piqa/parallel_cloze/nag_latn.yaml' 2026-09-01T00:40:27,386 adding 'lm_eval/tasks/global_piqa/parallel_cloze/nld_latn.yaml' 2026-09-01T00:40:27,387 adding 'lm_eval/tasks/global_piqa/parallel_cloze/nno_latn.yaml' 2026-09-01T00:40:27,388 adding 'lm_eval/tasks/global_piqa/parallel_cloze/nob_latn.yaml' 2026-09-01T00:40:27,389 adding 'lm_eval/tasks/global_piqa/parallel_cloze/npi_deva.yaml' 2026-09-01T00:40:27,390 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ory_orya.yaml' 2026-09-01T00:40:27,391 adding 'lm_eval/tasks/global_piqa/parallel_cloze/pan_guru.yaml' 2026-09-01T00:40:27,392 adding 'lm_eval/tasks/global_piqa/parallel_cloze/pcm_latn.yaml' 2026-09-01T00:40:27,394 adding 'lm_eval/tasks/global_piqa/parallel_cloze/pes_arab.yaml' 2026-09-01T00:40:27,395 adding 'lm_eval/tasks/global_piqa/parallel_cloze/plt_latn.yaml' 2026-09-01T00:40:27,396 adding 'lm_eval/tasks/global_piqa/parallel_cloze/pol_latn.yaml' 2026-09-01T00:40:27,397 adding 'lm_eval/tasks/global_piqa/parallel_cloze/por_latn_braz.yaml' 2026-09-01T00:40:27,398 adding 'lm_eval/tasks/global_piqa/parallel_cloze/por_latn_port.yaml' 2026-09-01T00:40:27,399 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ron_latn.yaml' 2026-09-01T00:40:27,400 adding 'lm_eval/tasks/global_piqa/parallel_cloze/rus_cyrl.yaml' 2026-09-01T00:40:27,402 adding 'lm_eval/tasks/global_piqa/parallel_cloze/rwr_deva.yaml' 2026-09-01T00:40:27,403 adding 'lm_eval/tasks/global_piqa/parallel_cloze/sin_latn.yaml' 2026-09-01T00:40:27,404 adding 'lm_eval/tasks/global_piqa/parallel_cloze/sin_sinh.yaml' 2026-09-01T00:40:27,405 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slk_latn.yaml' 2026-09-01T00:40:27,407 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slk_latn_sari.yaml' 2026-09-01T00:40:27,408 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slv_latn.yaml' 2026-09-01T00:40:27,409 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_cerk.yaml' 2026-09-01T00:40:27,410 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_prle.yaml' 2026-09-01T00:40:27,411 adding 'lm_eval/tasks/global_piqa/parallel_cloze/snd_arab.yaml' 2026-09-01T00:40:27,412 adding 'lm_eval/tasks/global_piqa/parallel_cloze/snd_deva.yaml' 2026-09-01T00:40:27,413 adding 'lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_mexi.yaml' 2026-09-01T00:40:27,414 adding 'lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_peru.yaml' 2026-09-01T00:40:27,416 adding 'lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_spai.yaml' 2026-09-01T00:40:27,417 adding 'lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl.yaml' 2026-09-01T00:40:27,418 adding 'lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl_torl.yaml' 2026-09-01T00:40:27,419 adding 'lm_eval/tasks/global_piqa/parallel_cloze/srp_latn.yaml' 2026-09-01T00:40:27,420 adding 'lm_eval/tasks/global_piqa/parallel_cloze/srp_latn_torl.yaml' 2026-09-01T00:40:27,422 adding 'lm_eval/tasks/global_piqa/parallel_cloze/swe_latn.yaml' 2026-09-01T00:40:27,423 adding 'lm_eval/tasks/global_piqa/parallel_cloze/swh_latn.yaml' 2026-09-01T00:40:27,424 adding 'lm_eval/tasks/global_piqa/parallel_cloze/swv_deva.yaml' 2026-09-01T00:40:27,425 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tam_latn.yaml' 2026-09-01T00:40:27,426 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tam_taml.yaml' 2026-09-01T00:40:27,427 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tel_latn.yaml' 2026-09-01T00:40:27,429 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tel_telu.yaml' 2026-09-01T00:40:27,430 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tgl_latn.yaml' 2026-09-01T00:40:27,431 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tha_thai.yaml' 2026-09-01T00:40:27,432 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tur_latn.yaml' 2026-09-01T00:40:27,433 adding 'lm_eval/tasks/global_piqa/parallel_cloze/uig_arab.yaml' 2026-09-01T00:40:27,434 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ukr_cyrl.yaml' 2026-09-01T00:40:27,436 adding 'lm_eval/tasks/global_piqa/parallel_cloze/urd_arab.yaml' 2026-09-01T00:40:27,437 adding 'lm_eval/tasks/global_piqa/parallel_cloze/urd_latn.yaml' 2026-09-01T00:40:27,438 adding 'lm_eval/tasks/global_piqa/parallel_cloze/urh_latn.yaml' 2026-09-01T00:40:27,439 adding 'lm_eval/tasks/global_piqa/parallel_cloze/uzn_latn.yaml' 2026-09-01T00:40:27,440 adding 'lm_eval/tasks/global_piqa/parallel_cloze/vie_latn.yaml' 2026-09-01T00:40:27,441 adding 'lm_eval/tasks/global_piqa/parallel_cloze/xho_latn.yaml' 2026-09-01T00:40:27,442 adding 'lm_eval/tasks/global_piqa/parallel_cloze/yor_latn.yaml' 2026-09-01T00:40:27,444 adding 'lm_eval/tasks/global_piqa/parallel_cloze/yue_hant.yaml' 2026-09-01T00:40:27,445 adding 'lm_eval/tasks/global_piqa/parallel_cloze/zsm_latn.yaml' 2026-09-01T00:40:27,446 adding 'lm_eval/tasks/global_piqa/parallel_cloze/zul_latn.yaml' 2026-09-01T00:40:27,451 adding 'lm_eval/tasks/global_piqa/parallel_generation/_generate_config.py' 2026-09-01T00:40:27,452 adding 'lm_eval/tasks/global_piqa/parallel_generation/_global_piqa_parallel_generation.yaml' 2026-09-01T00:40:27,454 adding 'lm_eval/tasks/global_piqa/parallel_generation/_template' 2026-09-01T00:40:27,455 adding 'lm_eval/tasks/global_piqa/parallel_generation/acm_arab.yaml' 2026-09-01T00:40:27,456 adding 'lm_eval/tasks/global_piqa/parallel_generation/acq_arab.yaml' 2026-09-01T00:40:27,457 adding 'lm_eval/tasks/global_piqa/parallel_generation/aeb_arab.yaml' 2026-09-01T00:40:27,458 adding 'lm_eval/tasks/global_piqa/parallel_generation/afb_arab.yaml' 2026-09-01T00:40:27,460 adding 'lm_eval/tasks/global_piqa/parallel_generation/als_latn.yaml' 2026-09-01T00:40:27,461 adding 'lm_eval/tasks/global_piqa/parallel_generation/amh_ethi.yaml' 2026-09-01T00:40:27,462 adding 'lm_eval/tasks/global_piqa/parallel_generation/apc_arab_jord.yaml' 2026-09-01T00:40:27,463 adding 'lm_eval/tasks/global_piqa/parallel_generation/apc_arab_leba.yaml' 2026-09-01T00:40:27,464 adding 'lm_eval/tasks/global_piqa/parallel_generation/apc_arab_pale.yaml' 2026-09-01T00:40:27,465 adding 'lm_eval/tasks/global_piqa/parallel_generation/apc_arab_syri.yaml' 2026-09-01T00:40:27,467 adding 'lm_eval/tasks/global_piqa/parallel_generation/arb_arab.yaml' 2026-09-01T00:40:27,468 adding 'lm_eval/tasks/global_piqa/parallel_generation/arq_arab.yaml' 2026-09-01T00:40:27,469 adding 'lm_eval/tasks/global_piqa/parallel_generation/ars_arab.yaml' 2026-09-01T00:40:27,470 adding 'lm_eval/tasks/global_piqa/parallel_generation/ary_arab.yaml' 2026-09-01T00:40:27,471 adding 'lm_eval/tasks/global_piqa/parallel_generation/arz_arab.yaml' 2026-09-01T00:40:27,472 adding 'lm_eval/tasks/global_piqa/parallel_generation/azj_latn.yaml' 2026-09-01T00:40:27,473 adding 'lm_eval/tasks/global_piqa/parallel_generation/bam_latn.yaml' 2026-09-01T00:40:27,474 adding 'lm_eval/tasks/global_piqa/parallel_generation/bcc_arab.yaml' 2026-09-01T00:40:27,476 adding 'lm_eval/tasks/global_piqa/parallel_generation/bel_cyrl.yaml' 2026-09-01T00:40:27,477 adding 'lm_eval/tasks/global_piqa/parallel_generation/ben_beng.yaml' 2026-09-01T00:40:27,478 adding 'lm_eval/tasks/global_piqa/parallel_generation/ben_latn.yaml' 2026-09-01T00:40:27,479 adding 'lm_eval/tasks/global_piqa/parallel_generation/bgc_deva.yaml' 2026-09-01T00:40:27,481 adding 'lm_eval/tasks/global_piqa/parallel_generation/bho_deva.yaml' 2026-09-01T00:40:27,482 adding 'lm_eval/tasks/global_piqa/parallel_generation/bra_deva.yaml' 2026-09-01T00:40:27,483 adding 'lm_eval/tasks/global_piqa/parallel_generation/bul_cyrl.yaml' 2026-09-01T00:40:27,484 adding 'lm_eval/tasks/global_piqa/parallel_generation/bxr_cyrl.yaml' 2026-09-01T00:40:27,485 adding 'lm_eval/tasks/global_piqa/parallel_generation/cat_latn.yaml' 2026-09-01T00:40:27,486 adding 'lm_eval/tasks/global_piqa/parallel_generation/ceb_latn.yaml' 2026-09-01T00:40:27,488 adding 'lm_eval/tasks/global_piqa/parallel_generation/ces_latn.yaml' 2026-09-01T00:40:27,489 adding 'lm_eval/tasks/global_piqa/parallel_generation/ckm_latn.yaml' 2026-09-01T00:40:27,490 adding 'lm_eval/tasks/global_piqa/parallel_generation/cls_deva.yaml' 2026-09-01T00:40:27,491 adding 'lm_eval/tasks/global_piqa/parallel_generation/cmn_hans.yaml' 2026-09-01T00:40:27,492 adding 'lm_eval/tasks/global_piqa/parallel_generation/cmn_hant.yaml' 2026-09-01T00:40:27,493 adding 'lm_eval/tasks/global_piqa/parallel_generation/dan_latn.yaml' 2026-09-01T00:40:27,494 adding 'lm_eval/tasks/global_piqa/parallel_generation/deu_latn.yaml' 2026-09-01T00:40:27,496 adding 'lm_eval/tasks/global_piqa/parallel_generation/dhd_deva.yaml' 2026-09-01T00:40:27,497 adding 'lm_eval/tasks/global_piqa/parallel_generation/ekk_latn.yaml' 2026-09-01T00:40:27,498 adding 'lm_eval/tasks/global_piqa/parallel_generation/ekp_latn.yaml' 2026-09-01T00:40:27,499 adding 'lm_eval/tasks/global_piqa/parallel_generation/ell_grek.yaml' 2026-09-01T00:40:27,500 adding 'lm_eval/tasks/global_piqa/parallel_generation/eng_latn.yaml' 2026-09-01T00:40:27,501 adding 'lm_eval/tasks/global_piqa/parallel_generation/eus_latn.yaml' 2026-09-01T00:40:27,503 adding 'lm_eval/tasks/global_piqa/parallel_generation/fao_latn.yaml' 2026-09-01T00:40:27,504 adding 'lm_eval/tasks/global_piqa/parallel_generation/fin_latn.yaml' 2026-09-01T00:40:27,505 adding 'lm_eval/tasks/global_piqa/parallel_generation/fra_latn_cana.yaml' 2026-09-01T00:40:27,506 adding 'lm_eval/tasks/global_piqa/parallel_generation/fra_latn_fran.yaml' 2026-09-01T00:40:27,507 adding 'lm_eval/tasks/global_piqa/parallel_generation/glg_latn.yaml' 2026-09-01T00:40:27,509 adding 'lm_eval/tasks/global_piqa/parallel_generation/guj_gujr.yaml' 2026-09-01T00:40:27,510 adding 'lm_eval/tasks/global_piqa/parallel_generation/hau_latn.yaml' 2026-09-01T00:40:27,511 adding 'lm_eval/tasks/global_piqa/parallel_generation/haw_latn.yaml' 2026-09-01T00:40:27,512 adding 'lm_eval/tasks/global_piqa/parallel_generation/heb_hebr.yaml' 2026-09-01T00:40:27,514 adding 'lm_eval/tasks/global_piqa/parallel_generation/hin_deva.yaml' 2026-09-01T00:40:27,515 adding 'lm_eval/tasks/global_piqa/parallel_generation/hin_latn.yaml' 2026-09-01T00:40:27,516 adding 'lm_eval/tasks/global_piqa/parallel_generation/hrv_latn.yaml' 2026-09-01T00:40:27,517 adding 'lm_eval/tasks/global_piqa/parallel_generation/hun_latn.yaml' 2026-09-01T00:40:27,518 adding 'lm_eval/tasks/global_piqa/parallel_generation/hye_armn.yaml' 2026-09-01T00:40:27,519 adding 'lm_eval/tasks/global_piqa/parallel_generation/ibo_latn.yaml' 2026-09-01T00:40:27,520 adding 'lm_eval/tasks/global_piqa/parallel_generation/idu_latn.yaml' 2026-09-01T00:40:27,521 adding 'lm_eval/tasks/global_piqa/parallel_generation/ilo_latn.yaml' 2026-09-01T00:40:27,522 adding 'lm_eval/tasks/global_piqa/parallel_generation/ind_latn.yaml' 2026-09-01T00:40:27,523 adding 'lm_eval/tasks/global_piqa/parallel_generation/isl_latn.yaml' 2026-09-01T00:40:27,525 adding 'lm_eval/tasks/global_piqa/parallel_generation/iso_latn.yaml' 2026-09-01T00:40:27,526 adding 'lm_eval/tasks/global_piqa/parallel_generation/ita_latn.yaml' 2026-09-01T00:40:27,527 adding 'lm_eval/tasks/global_piqa/parallel_generation/jav_latn.yaml' 2026-09-01T00:40:27,529 adding 'lm_eval/tasks/global_piqa/parallel_generation/jpn_jpan.yaml' 2026-09-01T00:40:27,530 adding 'lm_eval/tasks/global_piqa/parallel_generation/kan_knda.yaml' 2026-09-01T00:40:27,531 adding 'lm_eval/tasks/global_piqa/parallel_generation/kan_latn.yaml' 2026-09-01T00:40:27,532 adding 'lm_eval/tasks/global_piqa/parallel_generation/kat_geor.yaml' 2026-09-01T00:40:27,533 adding 'lm_eval/tasks/global_piqa/parallel_generation/kin_latn.yaml' 2026-09-01T00:40:27,534 adding 'lm_eval/tasks/global_piqa/parallel_generation/kir_cyrl.yaml' 2026-09-01T00:40:27,535 adding 'lm_eval/tasks/global_piqa/parallel_generation/kor_hang.yaml' 2026-09-01T00:40:27,537 adding 'lm_eval/tasks/global_piqa/parallel_generation/lin_latn.yaml' 2026-09-01T00:40:27,538 adding 'lm_eval/tasks/global_piqa/parallel_generation/lit_latn.yaml' 2026-09-01T00:40:27,539 adding 'lm_eval/tasks/global_piqa/parallel_generation/mag_deva.yaml' 2026-09-01T00:40:27,540 adding 'lm_eval/tasks/global_piqa/parallel_generation/mal_mlym.yaml' 2026-09-01T00:40:27,541 adding 'lm_eval/tasks/global_piqa/parallel_generation/mar_deva.yaml' 2026-09-01T00:40:27,542 adding 'lm_eval/tasks/global_piqa/parallel_generation/mkd_cyrl.yaml' 2026-09-01T00:40:27,543 adding 'lm_eval/tasks/global_piqa/parallel_generation/mni_beng.yaml' 2026-09-01T00:40:27,545 adding 'lm_eval/tasks/global_piqa/parallel_generation/nag_latn.yaml' 2026-09-01T00:40:27,546 adding 'lm_eval/tasks/global_piqa/parallel_generation/nld_latn.yaml' 2026-09-01T00:40:27,547 adding 'lm_eval/tasks/global_piqa/parallel_generation/nno_latn.yaml' 2026-09-01T00:40:27,549 adding 'lm_eval/tasks/global_piqa/parallel_generation/nob_latn.yaml' 2026-09-01T00:40:27,550 adding 'lm_eval/tasks/global_piqa/parallel_generation/npi_deva.yaml' 2026-09-01T00:40:27,551 adding 'lm_eval/tasks/global_piqa/parallel_generation/ory_orya.yaml' 2026-09-01T00:40:27,552 adding 'lm_eval/tasks/global_piqa/parallel_generation/pan_guru.yaml' 2026-09-01T00:40:27,553 adding 'lm_eval/tasks/global_piqa/parallel_generation/pcm_latn.yaml' 2026-09-01T00:40:27,554 adding 'lm_eval/tasks/global_piqa/parallel_generation/pes_arab.yaml' 2026-09-01T00:40:27,556 adding 'lm_eval/tasks/global_piqa/parallel_generation/plt_latn.yaml' 2026-09-01T00:40:27,557 adding 'lm_eval/tasks/global_piqa/parallel_generation/pol_latn.yaml' 2026-09-01T00:40:27,558 adding 'lm_eval/tasks/global_piqa/parallel_generation/por_latn_braz.yaml' 2026-09-01T00:40:27,559 adding 'lm_eval/tasks/global_piqa/parallel_generation/por_latn_port.yaml' 2026-09-01T00:40:27,560 adding 'lm_eval/tasks/global_piqa/parallel_generation/ron_latn.yaml' 2026-09-01T00:40:27,561 adding 'lm_eval/tasks/global_piqa/parallel_generation/rus_cyrl.yaml' 2026-09-01T00:40:27,563 adding 'lm_eval/tasks/global_piqa/parallel_generation/rwr_deva.yaml' 2026-09-01T00:40:27,564 adding 'lm_eval/tasks/global_piqa/parallel_generation/sin_latn.yaml' 2026-09-01T00:40:27,565 adding 'lm_eval/tasks/global_piqa/parallel_generation/sin_sinh.yaml' 2026-09-01T00:40:27,566 adding 'lm_eval/tasks/global_piqa/parallel_generation/slk_latn.yaml' 2026-09-01T00:40:27,567 adding 'lm_eval/tasks/global_piqa/parallel_generation/slk_latn_sari.yaml' 2026-09-01T00:40:27,568 adding 'lm_eval/tasks/global_piqa/parallel_generation/slv_latn.yaml' 2026-09-01T00:40:27,569 adding 'lm_eval/tasks/global_piqa/parallel_generation/slv_latn_cerk.yaml' 2026-09-01T00:40:27,570 adding 'lm_eval/tasks/global_piqa/parallel_generation/slv_latn_prle.yaml' 2026-09-01T00:40:27,571 adding 'lm_eval/tasks/global_piqa/parallel_generation/snd_arab.yaml' 2026-09-01T00:40:27,573 adding 'lm_eval/tasks/global_piqa/parallel_generation/snd_deva.yaml' 2026-09-01T00:40:27,574 adding 'lm_eval/tasks/global_piqa/parallel_generation/spa_latn_mexi.yaml' 2026-09-01T00:40:27,575 adding 'lm_eval/tasks/global_piqa/parallel_generation/spa_latn_peru.yaml' 2026-09-01T00:40:27,576 adding 'lm_eval/tasks/global_piqa/parallel_generation/spa_latn_spai.yaml' 2026-09-01T00:40:27,578 adding 'lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl.yaml' 2026-09-01T00:40:27,579 adding 'lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl_torl.yaml' 2026-09-01T00:40:27,580 adding 'lm_eval/tasks/global_piqa/parallel_generation/srp_latn.yaml' 2026-09-01T00:40:27,581 adding 'lm_eval/tasks/global_piqa/parallel_generation/srp_latn_torl.yaml' 2026-09-01T00:40:27,582 adding 'lm_eval/tasks/global_piqa/parallel_generation/swe_latn.yaml' 2026-09-01T00:40:27,583 adding 'lm_eval/tasks/global_piqa/parallel_generation/swh_latn.yaml' 2026-09-01T00:40:27,584 adding 'lm_eval/tasks/global_piqa/parallel_generation/swv_deva.yaml' 2026-09-01T00:40:27,586 adding 'lm_eval/tasks/global_piqa/parallel_generation/tam_latn.yaml' 2026-09-01T00:40:27,587 adding 'lm_eval/tasks/global_piqa/parallel_generation/tam_taml.yaml' 2026-09-01T00:40:27,588 adding 'lm_eval/tasks/global_piqa/parallel_generation/tel_latn.yaml' 2026-09-01T00:40:27,589 adding 'lm_eval/tasks/global_piqa/parallel_generation/tel_telu.yaml' 2026-09-01T00:40:27,590 adding 'lm_eval/tasks/global_piqa/parallel_generation/tgl_latn.yaml' 2026-09-01T00:40:27,591 adding 'lm_eval/tasks/global_piqa/parallel_generation/tha_thai.yaml' 2026-09-01T00:40:27,592 adding 'lm_eval/tasks/global_piqa/parallel_generation/tur_latn.yaml' 2026-09-01T00:40:27,594 adding 'lm_eval/tasks/global_piqa/parallel_generation/uig_arab.yaml' 2026-09-01T00:40:27,595 adding 'lm_eval/tasks/global_piqa/parallel_generation/ukr_cyrl.yaml' 2026-09-01T00:40:27,596 adding 'lm_eval/tasks/global_piqa/parallel_generation/urd_arab.yaml' 2026-09-01T00:40:27,597 adding 'lm_eval/tasks/global_piqa/parallel_generation/urd_latn.yaml' 2026-09-01T00:40:27,598 adding 'lm_eval/tasks/global_piqa/parallel_generation/urh_latn.yaml' 2026-09-01T00:40:27,599 adding 'lm_eval/tasks/global_piqa/parallel_generation/uzn_latn.yaml' 2026-09-01T00:40:27,600 adding 'lm_eval/tasks/global_piqa/parallel_generation/vie_latn.yaml' 2026-09-01T00:40:27,602 adding 'lm_eval/tasks/global_piqa/parallel_generation/xho_latn.yaml' 2026-09-01T00:40:27,603 adding 'lm_eval/tasks/global_piqa/parallel_generation/yor_latn.yaml' 2026-09-01T00:40:27,604 adding 'lm_eval/tasks/global_piqa/parallel_generation/yue_hant.yaml' 2026-09-01T00:40:27,605 adding 'lm_eval/tasks/global_piqa/parallel_generation/zsm_latn.yaml' 2026-09-01T00:40:27,606 adding 'lm_eval/tasks/global_piqa/parallel_generation/zul_latn.yaml' 2026-09-01T00:40:27,609 adding 'lm_eval/tasks/glue/README.md' 2026-09-01T00:40:27,610 adding 'lm_eval/tasks/glue/cola/default.yaml' 2026-09-01T00:40:27,612 adding 'lm_eval/tasks/glue/mnli/default.yaml' 2026-09-01T00:40:27,614 adding 'lm_eval/tasks/glue/mnli/mismatch.yaml' 2026-09-01T00:40:27,615 adding 'lm_eval/tasks/glue/mnli/utils.py' 2026-09-01T00:40:27,617 adding 'lm_eval/tasks/glue/mrpc/default.yaml' 2026-09-01T00:40:27,618 adding 'lm_eval/tasks/glue/qnli/default.yaml' 2026-09-01T00:40:27,620 adding 'lm_eval/tasks/glue/qqp/default.yaml' 2026-09-01T00:40:27,622 adding 'lm_eval/tasks/glue/rte/default.yaml' 2026-09-01T00:40:27,623 adding 'lm_eval/tasks/glue/sst2/default.yaml' 2026-09-01T00:40:27,625 adding 'lm_eval/tasks/glue/wnli/default.yaml' 2026-09-01T00:40:27,627 adding 'lm_eval/tasks/gpqa/README.md' 2026-09-01T00:40:27,629 adding 'lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py' 2026-09-01T00:40:27,630 adding 'lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml' 2026-09-01T00:40:27,631 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml' 2026-09-01T00:40:27,632 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml' 2026-09-01T00:40:27,633 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml' 2026-09-01T00:40:27,634 adding 'lm_eval/tasks/gpqa/cot_n_shot/utils.py' 2026-09-01T00:40:27,636 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py' 2026-09-01T00:40:27,637 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml' 2026-09-01T00:40:27,638 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml' 2026-09-01T00:40:27,639 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml' 2026-09-01T00:40:27,640 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml' 2026-09-01T00:40:27,642 adding 'lm_eval/tasks/gpqa/cot_zeroshot/utils.py' 2026-09-01T00:40:27,644 adding 'lm_eval/tasks/gpqa/generative/_generate_configs.py' 2026-09-01T00:40:27,645 adding 'lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml' 2026-09-01T00:40:27,646 adding 'lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml' 2026-09-01T00:40:27,648 adding 'lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml' 2026-09-01T00:40:27,649 adding 'lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml' 2026-09-01T00:40:27,650 adding 'lm_eval/tasks/gpqa/generative/utils.py' 2026-09-01T00:40:27,652 adding 'lm_eval/tasks/gpqa/n_shot/_generate_configs.py' 2026-09-01T00:40:27,653 adding 'lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml' 2026-09-01T00:40:27,654 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml' 2026-09-01T00:40:27,655 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml' 2026-09-01T00:40:27,657 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml' 2026-09-01T00:40:27,658 adding 'lm_eval/tasks/gpqa/n_shot/utils.py' 2026-09-01T00:40:27,660 adding 'lm_eval/tasks/gpqa/zeroshot/_generate_configs.py' 2026-09-01T00:40:27,661 adding 'lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml' 2026-09-01T00:40:27,662 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml' 2026-09-01T00:40:27,663 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml' 2026-09-01T00:40:27,664 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml' 2026-09-01T00:40:27,666 adding 'lm_eval/tasks/gpqa/zeroshot/utils.py' 2026-09-01T00:40:27,668 adding 'lm_eval/tasks/graphwalks/README.md' 2026-09-01T00:40:27,669 adding 'lm_eval/tasks/graphwalks/graphwalks.yaml' 2026-09-01T00:40:27,670 adding 'lm_eval/tasks/graphwalks/graphwalks_128k.yaml' 2026-09-01T00:40:27,671 adding 'lm_eval/tasks/graphwalks/graphwalks_1M.yaml' 2026-09-01T00:40:27,673 adding 'lm_eval/tasks/graphwalks/utils.py' 2026-09-01T00:40:27,676 adding 'lm_eval/tasks/greekmmlu/README.md' 2026-09-01T00:40:27,677 adding 'lm_eval/tasks/greekmmlu/_default_greekmmlu_template_yaml' 2026-09-01T00:40:27,679 adding 'lm_eval/tasks/greekmmlu/_generate_configs.py' 2026-09-01T00:40:27,680 adding 'lm_eval/tasks/greekmmlu/_greekmmlu.yaml' 2026-09-01T00:40:27,681 adding 'lm_eval/tasks/greekmmlu/_greekmmlu_humanities.yaml' 2026-09-01T00:40:27,682 adding 'lm_eval/tasks/greekmmlu/_greekmmlu_other.yaml' 2026-09-01T00:40:27,683 adding 'lm_eval/tasks/greekmmlu/_greekmmlu_social_sciences.yaml' 2026-09-01T00:40:27,685 adding 'lm_eval/tasks/greekmmlu/_greekmmlu_stem.yaml' 2026-09-01T00:40:27,686 adding 'lm_eval/tasks/greekmmlu/greekmmlu_accounting.yaml' 2026-09-01T00:40:27,687 adding 'lm_eval/tasks/greekmmlu/greekmmlu_agriculture_professional.yaml' 2026-09-01T00:40:27,688 adding 'lm_eval/tasks/greekmmlu/greekmmlu_agriculture_university.yaml' 2026-09-01T00:40:27,689 adding 'lm_eval/tasks/greekmmlu/greekmmlu_art_professional.yaml' 2026-09-01T00:40:27,690 adding 'lm_eval/tasks/greekmmlu/greekmmlu_art_secondary_school.yaml' 2026-09-01T00:40:27,691 adding 'lm_eval/tasks/greekmmlu/greekmmlu_art_university.yaml' 2026-09-01T00:40:27,692 adding 'lm_eval/tasks/greekmmlu/greekmmlu_biology.yaml' 2026-09-01T00:40:27,693 adding 'lm_eval/tasks/greekmmlu/greekmmlu_chemistry.yaml' 2026-09-01T00:40:27,694 adding 'lm_eval/tasks/greekmmlu/greekmmlu_civil_engineering.yaml' 2026-09-01T00:40:27,695 adding 'lm_eval/tasks/greekmmlu/greekmmlu_clinical_knowledge.yaml' 2026-09-01T00:40:27,697 adding 'lm_eval/tasks/greekmmlu/greekmmlu_computer_networks_and_security.yaml' 2026-09-01T00:40:27,698 adding 'lm_eval/tasks/greekmmlu/greekmmlu_computer_science_professional.yaml' 2026-09-01T00:40:27,699 adding 'lm_eval/tasks/greekmmlu/greekmmlu_computer_science_university.yaml' 2026-09-01T00:40:27,700 adding 'lm_eval/tasks/greekmmlu/greekmmlu_driving_rules.yaml' 2026-09-01T00:40:27,701 adding 'lm_eval/tasks/greekmmlu/greekmmlu_economics_professional.yaml' 2026-09-01T00:40:27,702 adding 'lm_eval/tasks/greekmmlu/greekmmlu_economics_university.yaml' 2026-09-01T00:40:27,703 adding 'lm_eval/tasks/greekmmlu/greekmmlu_education_professional.yaml' 2026-09-01T00:40:27,704 adding 'lm_eval/tasks/greekmmlu/greekmmlu_education_university.yaml' 2026-09-01T00:40:27,706 adding 'lm_eval/tasks/greekmmlu/greekmmlu_electrical_engineering.yaml' 2026-09-01T00:40:27,707 adding 'lm_eval/tasks/greekmmlu/greekmmlu_general_knowledge.yaml' 2026-09-01T00:40:27,708 adding 'lm_eval/tasks/greekmmlu/greekmmlu_geography_primary_school.yaml' 2026-09-01T00:40:27,709 adding 'lm_eval/tasks/greekmmlu/greekmmlu_geography_secondary_school.yaml' 2026-09-01T00:40:27,710 adding 'lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_primary_school.yaml' 2026-09-01T00:40:27,711 adding 'lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_secondary_school.yaml' 2026-09-01T00:40:27,712 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_history_primary_school.yaml' 2026-09-01T00:40:27,714 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_history_professional.yaml' 2026-09-01T00:40:27,715 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_history_secondary_school.yaml' 2026-09-01T00:40:27,716 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_literature.yaml' 2026-09-01T00:40:27,717 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_mythology.yaml' 2026-09-01T00:40:27,718 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_traditions.yaml' 2026-09-01T00:40:27,719 adding 'lm_eval/tasks/greekmmlu/greekmmlu_law.yaml' 2026-09-01T00:40:27,721 adding 'lm_eval/tasks/greekmmlu/greekmmlu_management_professional.yaml' 2026-09-01T00:40:27,722 adding 'lm_eval/tasks/greekmmlu/greekmmlu_management_university.yaml' 2026-09-01T00:40:27,723 adding 'lm_eval/tasks/greekmmlu/greekmmlu_maritime_safety_and_rescue_operations.yaml' 2026-09-01T00:40:27,724 adding 'lm_eval/tasks/greekmmlu/greekmmlu_mathematics.yaml' 2026-09-01T00:40:27,725 adding 'lm_eval/tasks/greekmmlu/greekmmlu_medicine_professional.yaml' 2026-09-01T00:40:27,727 adding 'lm_eval/tasks/greekmmlu/greekmmlu_medicine_university.yaml' 2026-09-01T00:40:27,728 adding 'lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_primary_school.yaml' 2026-09-01T00:40:27,729 adding 'lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_secondary_school.yaml' 2026-09-01T00:40:27,730 adding 'lm_eval/tasks/greekmmlu/greekmmlu_physics_primary_school.yaml' 2026-09-01T00:40:27,733 adding 'lm_eval/tasks/greekmmlu/greekmmlu_physics_professional.yaml' 2026-09-01T00:40:27,734 adding 'lm_eval/tasks/greekmmlu/greekmmlu_physics_university.yaml' 2026-09-01T00:40:27,735 adding 'lm_eval/tasks/greekmmlu/greekmmlu_prehistory.yaml' 2026-09-01T00:40:27,737 adding 'lm_eval/tasks/greekmmlu/greekmmlu_world_history.yaml' 2026-09-01T00:40:27,738 adding 'lm_eval/tasks/greekmmlu/greekmmlu_world_religions.yaml' 2026-09-01T00:40:27,739 adding 'lm_eval/tasks/greekmmlu/utils.py' 2026-09-01T00:40:27,741 adding 'lm_eval/tasks/groundcocoa/README.md' 2026-09-01T00:40:27,742 adding 'lm_eval/tasks/groundcocoa/groundcocoa.yaml' 2026-09-01T00:40:27,743 adding 'lm_eval/tasks/groundcocoa/utils.py' 2026-09-01T00:40:27,745 adding 'lm_eval/tasks/gsm8k/README.md' 2026-09-01T00:40:27,747 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml' 2026-09-01T00:40:27,748 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml' 2026-09-01T00:40:27,749 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml' 2026-09-01T00:40:27,751 adding 'lm_eval/tasks/gsm8k/gsm8k-cot.yaml' 2026-09-01T00:40:27,752 adding 'lm_eval/tasks/gsm8k/gsm8k.yaml' 2026-09-01T00:40:27,754 adding 'lm_eval/tasks/gsm8k_platinum/README.md' 2026-09-01T00:40:27,755 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml' 2026-09-01T00:40:27,756 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml' 2026-09-01T00:40:27,758 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml' 2026-09-01T00:40:27,759 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml' 2026-09-01T00:40:27,760 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml' 2026-09-01T00:40:27,762 adding 'lm_eval/tasks/gsm_plus/README.md' 2026-09-01T00:40:27,763 adding 'lm_eval/tasks/gsm_plus/gsm_plus.yaml' 2026-09-01T00:40:27,765 adding 'lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml' 2026-09-01T00:40:27,767 adding 'lm_eval/tasks/haerae/README.md' 2026-09-01T00:40:27,768 adding 'lm_eval/tasks/haerae/_default_haerae_yaml' 2026-09-01T00:40:27,769 adding 'lm_eval/tasks/haerae/_haerae.yaml' 2026-09-01T00:40:27,770 adding 'lm_eval/tasks/haerae/haerae_gk.yaml' 2026-09-01T00:40:27,771 adding 'lm_eval/tasks/haerae/haerae_hi.yaml' 2026-09-01T00:40:27,772 adding 'lm_eval/tasks/haerae/haerae_lw.yaml' 2026-09-01T00:40:27,774 adding 'lm_eval/tasks/haerae/haerae_rw.yaml' 2026-09-01T00:40:27,775 adding 'lm_eval/tasks/haerae/haerae_sn.yaml' 2026-09-01T00:40:27,777 adding 'lm_eval/tasks/headqa/README.md' 2026-09-01T00:40:27,778 adding 'lm_eval/tasks/headqa/headqa_en.yaml' 2026-09-01T00:40:27,779 adding 'lm_eval/tasks/headqa/headqa_es.yaml' 2026-09-01T00:40:27,781 adding 'lm_eval/tasks/hellaswag/README.md' 2026-09-01T00:40:27,782 adding 'lm_eval/tasks/hellaswag/hellaswag.yaml' 2026-09-01T00:40:27,783 adding 'lm_eval/tasks/hellaswag/utils.py' 2026-09-01T00:40:27,785 adding 'lm_eval/tasks/hendrycks_ethics/README.md' 2026-09-01T00:40:27,787 adding 'lm_eval/tasks/hendrycks_ethics/commonsense.yaml' 2026-09-01T00:40:27,788 adding 'lm_eval/tasks/hendrycks_ethics/deontology.yaml' 2026-09-01T00:40:27,789 adding 'lm_eval/tasks/hendrycks_ethics/justice.yaml' 2026-09-01T00:40:27,790 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml' 2026-09-01T00:40:27,791 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml' 2026-09-01T00:40:27,792 adding 'lm_eval/tasks/hendrycks_ethics/utils.py' 2026-09-01T00:40:27,794 adding 'lm_eval/tasks/hendrycks_ethics/virtue.yaml' 2026-09-01T00:40:27,796 adding 'lm_eval/tasks/hendrycks_math/README.md' 2026-09-01T00:40:27,797 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math.yaml' 2026-09-01T00:40:27,798 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml' 2026-09-01T00:40:27,799 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml' 2026-09-01T00:40:27,800 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml' 2026-09-01T00:40:27,802 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml' 2026-09-01T00:40:27,803 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml' 2026-09-01T00:40:27,804 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml' 2026-09-01T00:40:27,805 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml' 2026-09-01T00:40:27,806 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml' 2026-09-01T00:40:27,808 adding 'lm_eval/tasks/hendrycks_math/utils.py' 2026-09-01T00:40:27,809 adding 'lm_eval/tasks/histoires_morales/README.md' 2026-09-01T00:40:27,811 adding 'lm_eval/tasks/histoires_morales/histoires_morales.yaml' 2026-09-01T00:40:27,812 adding 'lm_eval/tasks/histoires_morales/utils.py' 2026-09-01T00:40:27,814 adding 'lm_eval/tasks/hrm8k/README.md' 2026-09-01T00:40:27,815 adding 'lm_eval/tasks/hrm8k/default/_hrm8k_yaml' 2026-09-01T00:40:27,816 adding 'lm_eval/tasks/hrm8k/default/hrm8k.yaml' 2026-09-01T00:40:27,818 adding 'lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml' 2026-09-01T00:40:27,819 adding 'lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml' 2026-09-01T00:40:27,820 adding 'lm_eval/tasks/hrm8k/default/hrm8k_math.yaml' 2026-09-01T00:40:27,821 adding 'lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml' 2026-09-01T00:40:27,822 adding 'lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml' 2026-09-01T00:40:27,824 adding 'lm_eval/tasks/hrm8k/default/utils.py' 2026-09-01T00:40:27,826 adding 'lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml' 2026-09-01T00:40:27,827 adding 'lm_eval/tasks/hrm8k/en/hrm8k_en.yaml' 2026-09-01T00:40:27,828 adding 'lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml' 2026-09-01T00:40:27,829 adding 'lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml' 2026-09-01T00:40:27,830 adding 'lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml' 2026-09-01T00:40:27,831 adding 'lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml' 2026-09-01T00:40:27,833 adding 'lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml' 2026-09-01T00:40:27,834 adding 'lm_eval/tasks/hrm8k/en/utils.py' 2026-09-01T00:40:27,837 adding 'lm_eval/tasks/humaneval/README.md' 2026-09-01T00:40:27,838 adding 'lm_eval/tasks/humaneval/humaneval.yaml' 2026-09-01T00:40:27,839 adding 'lm_eval/tasks/humaneval/humaneval_64.yaml' 2026-09-01T00:40:27,840 adding 'lm_eval/tasks/humaneval/humaneval_64_instruct.yaml' 2026-09-01T00:40:27,842 adding 'lm_eval/tasks/humaneval/humaneval_instruct.yaml' 2026-09-01T00:40:27,843 adding 'lm_eval/tasks/humaneval/humaneval_plus.yaml' 2026-09-01T00:40:27,844 adding 'lm_eval/tasks/humaneval/utils.py' 2026-09-01T00:40:27,846 adding 'lm_eval/tasks/humaneval_infilling/README.md' 2026-09-01T00:40:27,847 adding 'lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml' 2026-09-01T00:40:27,848 adding 'lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml' 2026-09-01T00:40:27,849 adding 'lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml' 2026-09-01T00:40:27,851 adding 'lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml' 2026-09-01T00:40:27,852 adding 'lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml' 2026-09-01T00:40:27,853 adding 'lm_eval/tasks/humaneval_infilling/utils.py' 2026-09-01T00:40:27,855 adding 'lm_eval/tasks/icelandic_winogrande/README.md' 2026-09-01T00:40:27,856 adding 'lm_eval/tasks/icelandic_winogrande/default.yaml' 2026-09-01T00:40:27,857 adding 'lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py' 2026-09-01T00:40:27,860 adding 'lm_eval/tasks/ifeval/README.md' 2026-09-01T00:40:27,861 adding 'lm_eval/tasks/ifeval/ifeval.yaml' 2026-09-01T00:40:27,866 adding 'lm_eval/tasks/ifeval/instructions.py' 2026-09-01T00:40:27,868 adding 'lm_eval/tasks/ifeval/instructions_registry.py' 2026-09-01T00:40:27,871 adding 'lm_eval/tasks/ifeval/instructions_util.py' 2026-09-01T00:40:27,873 adding 'lm_eval/tasks/ifeval/utils.py' 2026-09-01T00:40:27,875 adding 'lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml' 2026-09-01T00:40:27,876 adding 'lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml' 2026-09-01T00:40:27,878 adding 'lm_eval/tasks/ifeval/multilingual/instructions_registry.py' 2026-09-01T00:40:27,879 adding 'lm_eval/tasks/ifeval/multilingual/utils.py' 2026-09-01T00:40:27,881 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py' 2026-09-01T00:40:27,882 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py' 2026-09-01T00:40:27,884 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py' 2026-09-01T00:40:27,886 adding 'lm_eval/tasks/ifeval/multilingual/instructions/__init__.py' 2026-09-01T00:40:27,892 adding 'lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py' 2026-09-01T00:40:27,898 adding 'lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py' 2026-09-01T00:40:27,901 adding 'lm_eval/tasks/include/README.md' 2026-09-01T00:40:27,904 adding 'lm_eval/tasks/include/default/Albanian/_albanian_template_yaml' 2026-09-01T00:40:27,905 adding 'lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml' 2026-09-01T00:40:27,906 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-09-01T00:40:27,907 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-09-01T00:40:27,908 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-09-01T00:40:27,909 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml' 2026-09-01T00:40:27,911 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml' 2026-09-01T00:40:27,912 adding 'lm_eval/tasks/include/default/Albanian/utils.py' 2026-09-01T00:40:27,914 adding 'lm_eval/tasks/include/default/Arabic/_arabic_template_yaml' 2026-09-01T00:40:27,915 adding 'lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml' 2026-09-01T00:40:27,916 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-09-01T00:40:27,917 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-09-01T00:40:27,918 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml' 2026-09-01T00:40:27,919 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-09-01T00:40:27,921 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml' 2026-09-01T00:40:27,922 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml' 2026-09-01T00:40:27,923 adding 'lm_eval/tasks/include/default/Arabic/utils.py' 2026-09-01T00:40:27,925 adding 'lm_eval/tasks/include/default/Armenian/_armenian_template_yaml' 2026-09-01T00:40:27,926 adding 'lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml' 2026-09-01T00:40:27,927 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-09-01T00:40:27,928 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml' 2026-09-01T00:40:27,930 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml' 2026-09-01T00:40:27,931 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml' 2026-09-01T00:40:27,932 adding 'lm_eval/tasks/include/default/Armenian/utils.py' 2026-09-01T00:40:27,934 adding 'lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml' 2026-09-01T00:40:27,936 adding 'lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-09-01T00:40:27,937 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-09-01T00:40:27,938 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-09-01T00:40:27,939 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-09-01T00:40:27,941 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-09-01T00:40:27,942 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-09-01T00:40:27,943 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-09-01T00:40:27,944 adding 'lm_eval/tasks/include/default/Azerbaijani/utils.py' 2026-09-01T00:40:27,946 adding 'lm_eval/tasks/include/default/Basque/_basque_template_yaml' 2026-09-01T00:40:27,947 adding 'lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml' 2026-09-01T00:40:27,949 adding 'lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml' 2026-09-01T00:40:27,950 adding 'lm_eval/tasks/include/default/Basque/utils.py' 2026-09-01T00:40:27,952 adding 'lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml' 2026-09-01T00:40:27,953 adding 'lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml' 2026-09-01T00:40:27,954 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-09-01T00:40:27,955 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-09-01T00:40:27,956 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml' 2026-09-01T00:40:27,957 adding 'lm_eval/tasks/include/default/Belarusian/utils.py' 2026-09-01T00:40:27,959 adding 'lm_eval/tasks/include/default/Bengali/_bengali_template_yaml' 2026-09-01T00:40:27,960 adding 'lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml' 2026-09-01T00:40:27,961 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-09-01T00:40:27,963 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-09-01T00:40:27,964 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-09-01T00:40:27,965 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml' 2026-09-01T00:40:27,966 adding 'lm_eval/tasks/include/default/Bengali/utils.py' 2026-09-01T00:40:27,968 adding 'lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml' 2026-09-01T00:40:27,969 adding 'lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml' 2026-09-01T00:40:27,971 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-09-01T00:40:27,972 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-09-01T00:40:27,973 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-09-01T00:40:27,974 adding 'lm_eval/tasks/include/default/Bulgarian/utils.py' 2026-09-01T00:40:27,976 adding 'lm_eval/tasks/include/default/Chinese/_chinese_template_yaml' 2026-09-01T00:40:27,977 adding 'lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml' 2026-09-01T00:40:27,978 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml' 2026-09-01T00:40:27,980 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-09-01T00:40:27,981 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-09-01T00:40:27,982 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml' 2026-09-01T00:40:27,983 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-09-01T00:40:27,984 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-09-01T00:40:27,986 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml' 2026-09-01T00:40:27,987 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml' 2026-09-01T00:40:27,988 adding 'lm_eval/tasks/include/default/Chinese/utils.py' 2026-09-01T00:40:27,990 adding 'lm_eval/tasks/include/default/Croatian/_croatian_template_yaml' 2026-09-01T00:40:27,992 adding 'lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml' 2026-09-01T00:40:27,993 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-09-01T00:40:27,994 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml' 2026-09-01T00:40:27,996 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml' 2026-09-01T00:40:27,997 adding 'lm_eval/tasks/include/default/Croatian/utils.py' 2026-09-01T00:40:27,999 adding 'lm_eval/tasks/include/default/Dutch/_dutch_template_yaml' 2026-09-01T00:40:28,000 adding 'lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml' 2026-09-01T00:40:28,001 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml' 2026-09-01T00:40:28,002 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-09-01T00:40:28,003 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-09-01T00:40:28,004 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml' 2026-09-01T00:40:28,006 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml' 2026-09-01T00:40:28,007 adding 'lm_eval/tasks/include/default/Dutch/utils.py' 2026-09-01T00:40:28,009 adding 'lm_eval/tasks/include/default/Estonian/_estonian_template_yaml' 2026-09-01T00:40:28,010 adding 'lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml' 2026-09-01T00:40:28,011 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml' 2026-09-01T00:40:28,012 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-09-01T00:40:28,013 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-09-01T00:40:28,015 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml' 2026-09-01T00:40:28,016 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml' 2026-09-01T00:40:28,017 adding 'lm_eval/tasks/include/default/Estonian/utils.py' 2026-09-01T00:40:28,019 adding 'lm_eval/tasks/include/default/Finnish/_finnish_template_yaml' 2026-09-01T00:40:28,020 adding 'lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml' 2026-09-01T00:40:28,021 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml' 2026-09-01T00:40:28,023 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-09-01T00:40:28,024 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-09-01T00:40:28,025 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml' 2026-09-01T00:40:28,026 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml' 2026-09-01T00:40:28,028 adding 'lm_eval/tasks/include/default/Finnish/utils.py' 2026-09-01T00:40:28,030 adding 'lm_eval/tasks/include/default/French/_french_template_yaml' 2026-09-01T00:40:28,031 adding 'lm_eval/tasks/include/default/French/_include_base_44_french.yaml' 2026-09-01T00:40:28,032 adding 'lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml' 2026-09-01T00:40:28,033 adding 'lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml' 2026-09-01T00:40:28,034 adding 'lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml' 2026-09-01T00:40:28,036 adding 'lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml' 2026-09-01T00:40:28,037 adding 'lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml' 2026-09-01T00:40:28,038 adding 'lm_eval/tasks/include/default/French/utils.py' 2026-09-01T00:40:28,040 adding 'lm_eval/tasks/include/default/Georgian/_georgian_template_yaml' 2026-09-01T00:40:28,041 adding 'lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml' 2026-09-01T00:40:28,042 adding 'lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-09-01T00:40:28,044 adding 'lm_eval/tasks/include/default/Georgian/utils.py' 2026-09-01T00:40:28,046 adding 'lm_eval/tasks/include/default/German/_german_template_yaml' 2026-09-01T00:40:28,047 adding 'lm_eval/tasks/include/default/German/_include_base_44_german.yaml' 2026-09-01T00:40:28,048 adding 'lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml' 2026-09-01T00:40:28,049 adding 'lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml' 2026-09-01T00:40:28,050 adding 'lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml' 2026-09-01T00:40:28,051 adding 'lm_eval/tasks/include/default/German/utils.py' 2026-09-01T00:40:28,053 adding 'lm_eval/tasks/include/default/Greek/_greek_template_yaml' 2026-09-01T00:40:28,055 adding 'lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml' 2026-09-01T00:40:28,056 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml' 2026-09-01T00:40:28,057 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml' 2026-09-01T00:40:28,059 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-09-01T00:40:28,060 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml' 2026-09-01T00:40:28,061 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml' 2026-09-01T00:40:28,062 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml' 2026-09-01T00:40:28,063 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml' 2026-09-01T00:40:28,065 adding 'lm_eval/tasks/include/default/Greek/utils.py' 2026-09-01T00:40:28,066 adding 'lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml' 2026-09-01T00:40:28,068 adding 'lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml' 2026-09-01T00:40:28,069 adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-09-01T00:40:28,070 adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-09-01T00:40:28,071 adding 'lm_eval/tasks/include/default/Hebrew/utils.py' 2026-09-01T00:40:28,073 adding 'lm_eval/tasks/include/default/Hindi/_hindi_template_yaml' 2026-09-01T00:40:28,074 adding 'lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml' 2026-09-01T00:40:28,076 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml' 2026-09-01T00:40:28,077 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-09-01T00:40:28,078 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml' 2026-09-01T00:40:28,079 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-09-01T00:40:28,081 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-09-01T00:40:28,082 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-09-01T00:40:28,083 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml' 2026-09-01T00:40:28,084 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml' 2026-09-01T00:40:28,085 adding 'lm_eval/tasks/include/default/Hindi/utils.py' 2026-09-01T00:40:28,087 adding 'lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml' 2026-09-01T00:40:28,088 adding 'lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml' 2026-09-01T00:40:28,090 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-09-01T00:40:28,091 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-09-01T00:40:28,092 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml' 2026-09-01T00:40:28,093 adding 'lm_eval/tasks/include/default/Hungarian/utils.py' 2026-09-01T00:40:28,095 adding 'lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml' 2026-09-01T00:40:28,097 adding 'lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml' 2026-09-01T00:40:28,098 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-09-01T00:40:28,099 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-09-01T00:40:28,100 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-09-01T00:40:28,101 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-09-01T00:40:28,102 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml' 2026-09-01T00:40:28,104 adding 'lm_eval/tasks/include/default/Indonesian/utils.py' 2026-09-01T00:40:28,105 adding 'lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml' 2026-09-01T00:40:28,107 adding 'lm_eval/tasks/include/default/Italian/_italian_template_yaml' 2026-09-01T00:40:28,108 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml' 2026-09-01T00:40:28,109 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml' 2026-09-01T00:40:28,110 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-09-01T00:40:28,111 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml' 2026-09-01T00:40:28,113 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml' 2026-09-01T00:40:28,114 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml' 2026-09-01T00:40:28,115 adding 'lm_eval/tasks/include/default/Italian/utils.py' 2026-09-01T00:40:28,117 adding 'lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml' 2026-09-01T00:40:28,118 adding 'lm_eval/tasks/include/default/Japanese/_japanese_template_yaml' 2026-09-01T00:40:28,119 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml' 2026-09-01T00:40:28,121 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml' 2026-09-01T00:40:28,122 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-09-01T00:40:28,123 adding 'lm_eval/tasks/include/default/Japanese/utils.py' 2026-09-01T00:40:28,125 adding 'lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml' 2026-09-01T00:40:28,126 adding 'lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml' 2026-09-01T00:40:28,128 adding 'lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-09-01T00:40:28,129 adding 'lm_eval/tasks/include/default/Kazakh/utils.py' 2026-09-01T00:40:28,131 adding 'lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml' 2026-09-01T00:40:28,132 adding 'lm_eval/tasks/include/default/Korean/_korean_template_yaml' 2026-09-01T00:40:28,133 adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml' 2026-09-01T00:40:28,135 adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml' 2026-09-01T00:40:28,136 adding 'lm_eval/tasks/include/default/Korean/utils.py' 2026-09-01T00:40:28,138 adding 'lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml' 2026-09-01T00:40:28,139 adding 'lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml' 2026-09-01T00:40:28,141 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-09-01T00:40:28,142 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-09-01T00:40:28,143 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-09-01T00:40:28,144 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-09-01T00:40:28,145 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-09-01T00:40:28,147 adding 'lm_eval/tasks/include/default/Lithuanian/utils.py' 2026-09-01T00:40:28,148 adding 'lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml' 2026-09-01T00:40:28,150 adding 'lm_eval/tasks/include/default/Malay/_malay_template_yaml' 2026-09-01T00:40:28,151 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml' 2026-09-01T00:40:28,152 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml' 2026-09-01T00:40:28,153 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml' 2026-09-01T00:40:28,154 adding 'lm_eval/tasks/include/default/Malay/utils.py' 2026-09-01T00:40:28,156 adding 'lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml' 2026-09-01T00:40:28,157 adding 'lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml' 2026-09-01T00:40:28,159 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-09-01T00:40:28,160 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-09-01T00:40:28,161 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-09-01T00:40:28,162 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-09-01T00:40:28,163 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-09-01T00:40:28,165 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml' 2026-09-01T00:40:28,166 adding 'lm_eval/tasks/include/default/Malayalam/utils.py' 2026-09-01T00:40:28,168 adding 'lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml' 2026-09-01T00:40:28,169 adding 'lm_eval/tasks/include/default/Nepali/_nepali_template_yaml' 2026-09-01T00:40:28,170 adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml' 2026-09-01T00:40:28,171 adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-09-01T00:40:28,173 adding 'lm_eval/tasks/include/default/Nepali/utils.py' 2026-09-01T00:40:28,175 adding 'lm_eval/tasks/include/default/North Macedonian/_include_base_44_north_macedonian.yaml' 2026-09-01T00:40:28,176 adding 'lm_eval/tasks/include/default/North Macedonian/_north_macedonian_template_yaml' 2026-09-01T00:40:28,177 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml' 2026-09-01T00:40:28,178 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml' 2026-09-01T00:40:28,179 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_social_science.yaml' 2026-09-01T00:40:28,181 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_stem.yaml' 2026-09-01T00:40:28,182 adding 'lm_eval/tasks/include/default/North Macedonian/utils.py' 2026-09-01T00:40:28,184 adding 'lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml' 2026-09-01T00:40:28,185 adding 'lm_eval/tasks/include/default/Persian/_persian_template_yaml' 2026-09-01T00:40:28,186 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml' 2026-09-01T00:40:28,187 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml' 2026-09-01T00:40:28,189 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml' 2026-09-01T00:40:28,190 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml' 2026-09-01T00:40:28,191 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml' 2026-09-01T00:40:28,192 adding 'lm_eval/tasks/include/default/Persian/utils.py' 2026-09-01T00:40:28,194 adding 'lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml' 2026-09-01T00:40:28,195 adding 'lm_eval/tasks/include/default/Polish/_polish_template_yaml' 2026-09-01T00:40:28,196 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml' 2026-09-01T00:40:28,197 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml' 2026-09-01T00:40:28,199 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml' 2026-09-01T00:40:28,200 adding 'lm_eval/tasks/include/default/Polish/utils.py' 2026-09-01T00:40:28,202 adding 'lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml' 2026-09-01T00:40:28,203 adding 'lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml' 2026-09-01T00:40:28,204 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-09-01T00:40:28,205 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-09-01T00:40:28,207 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-09-01T00:40:28,208 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-09-01T00:40:28,209 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-09-01T00:40:28,210 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml' 2026-09-01T00:40:28,211 adding 'lm_eval/tasks/include/default/Portuguese/utils.py' 2026-09-01T00:40:28,213 adding 'lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml' 2026-09-01T00:40:28,215 adding 'lm_eval/tasks/include/default/Russian/_russian_template_yaml' 2026-09-01T00:40:28,216 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml' 2026-09-01T00:40:28,217 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml' 2026-09-01T00:40:28,218 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml' 2026-09-01T00:40:28,219 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml' 2026-09-01T00:40:28,221 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-09-01T00:40:28,222 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml' 2026-09-01T00:40:28,223 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml' 2026-09-01T00:40:28,224 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml' 2026-09-01T00:40:28,226 adding 'lm_eval/tasks/include/default/Russian/utils.py' 2026-09-01T00:40:28,227 adding 'lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml' 2026-09-01T00:40:28,229 adding 'lm_eval/tasks/include/default/Serbian/_serbian_template_yaml' 2026-09-01T00:40:28,230 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-09-01T00:40:28,231 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml' 2026-09-01T00:40:28,232 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml' 2026-09-01T00:40:28,234 adding 'lm_eval/tasks/include/default/Serbian/utils.py' 2026-09-01T00:40:28,236 adding 'lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml' 2026-09-01T00:40:28,237 adding 'lm_eval/tasks/include/default/Spanish/_spanish_template_yaml' 2026-09-01T00:40:28,238 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-09-01T00:40:28,239 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-09-01T00:40:28,241 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml' 2026-09-01T00:40:28,242 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml' 2026-09-01T00:40:28,243 adding 'lm_eval/tasks/include/default/Spanish/utils.py' 2026-09-01T00:40:28,245 adding 'lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml' 2026-09-01T00:40:28,246 adding 'lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml' 2026-09-01T00:40:28,247 adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-09-01T00:40:28,249 adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-09-01T00:40:28,250 adding 'lm_eval/tasks/include/default/Tagalog/utils.py' 2026-09-01T00:40:28,253 adding 'lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml' 2026-09-01T00:40:28,254 adding 'lm_eval/tasks/include/default/Tamil/_tamil_template_yaml' 2026-09-01T00:40:28,255 adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-09-01T00:40:28,256 adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml' 2026-09-01T00:40:28,258 adding 'lm_eval/tasks/include/default/Tamil/utils.py' 2026-09-01T00:40:28,259 adding 'lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml' 2026-09-01T00:40:28,261 adding 'lm_eval/tasks/include/default/Telugu/_telugu_template_yaml' 2026-09-01T00:40:28,262 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml' 2026-09-01T00:40:28,263 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-09-01T00:40:28,264 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml' 2026-09-01T00:40:28,265 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml' 2026-09-01T00:40:28,267 adding 'lm_eval/tasks/include/default/Telugu/utils.py' 2026-09-01T00:40:28,268 adding 'lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml' 2026-09-01T00:40:28,270 adding 'lm_eval/tasks/include/default/Turkish/_turkish_template_yaml' 2026-09-01T00:40:28,271 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-09-01T00:40:28,272 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-09-01T00:40:28,273 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml' 2026-09-01T00:40:28,274 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml' 2026-09-01T00:40:28,276 adding 'lm_eval/tasks/include/default/Turkish/utils.py' 2026-09-01T00:40:28,277 adding 'lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml' 2026-09-01T00:40:28,279 adding 'lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml' 2026-09-01T00:40:28,280 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-09-01T00:40:28,281 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-09-01T00:40:28,282 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-09-01T00:40:28,284 adding 'lm_eval/tasks/include/default/Ukrainian/utils.py' 2026-09-01T00:40:28,286 adding 'lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml' 2026-09-01T00:40:28,287 adding 'lm_eval/tasks/include/default/Urdu/_urdu_template_yaml' 2026-09-01T00:40:28,288 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-09-01T00:40:28,289 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-09-01T00:40:28,291 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml' 2026-09-01T00:40:28,292 adding 'lm_eval/tasks/include/default/Urdu/utils.py' 2026-09-01T00:40:28,294 adding 'lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml' 2026-09-01T00:40:28,295 adding 'lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml' 2026-09-01T00:40:28,296 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-09-01T00:40:28,297 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-09-01T00:40:28,298 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-09-01T00:40:28,299 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml' 2026-09-01T00:40:28,300 adding 'lm_eval/tasks/include/default/Uzbek/utils.py' 2026-09-01T00:40:28,302 adding 'lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml' 2026-09-01T00:40:28,303 adding 'lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml' 2026-09-01T00:40:28,305 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-09-01T00:40:28,306 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-09-01T00:40:28,307 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-09-01T00:40:28,308 adding 'lm_eval/tasks/include/default/Vietnamese/utils.py' 2026-09-01T00:40:28,311 adding 'lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml' 2026-09-01T00:40:28,312 adding 'lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml' 2026-09-01T00:40:28,314 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-09-01T00:40:28,315 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-09-01T00:40:28,316 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-09-01T00:40:28,317 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml' 2026-09-01T00:40:28,318 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml' 2026-09-01T00:40:28,320 adding 'lm_eval/tasks/include/few_shot_en/Albanian/utils.py' 2026-09-01T00:40:28,322 adding 'lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml' 2026-09-01T00:40:28,323 adding 'lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml' 2026-09-01T00:40:28,324 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-09-01T00:40:28,325 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-09-01T00:40:28,326 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml' 2026-09-01T00:40:28,327 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-09-01T00:40:28,329 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml' 2026-09-01T00:40:28,330 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml' 2026-09-01T00:40:28,331 adding 'lm_eval/tasks/include/few_shot_en/Arabic/utils.py' 2026-09-01T00:40:28,333 adding 'lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml' 2026-09-01T00:40:28,334 adding 'lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml' 2026-09-01T00:40:28,335 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-09-01T00:40:28,337 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml' 2026-09-01T00:40:28,338 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml' 2026-09-01T00:40:28,339 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml' 2026-09-01T00:40:28,340 adding 'lm_eval/tasks/include/few_shot_en/Armenian/utils.py' 2026-09-01T00:40:28,342 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml' 2026-09-01T00:40:28,343 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-09-01T00:40:28,345 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-09-01T00:40:28,346 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-09-01T00:40:28,347 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-09-01T00:40:28,348 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-09-01T00:40:28,349 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-09-01T00:40:28,350 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-09-01T00:40:28,351 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py' 2026-09-01T00:40:28,353 adding 'lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml' 2026-09-01T00:40:28,354 adding 'lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml' 2026-09-01T00:40:28,355 adding 'lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml' 2026-09-01T00:40:28,357 adding 'lm_eval/tasks/include/few_shot_en/Basque/utils.py' 2026-09-01T00:40:28,359 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml' 2026-09-01T00:40:28,360 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml' 2026-09-01T00:40:28,361 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-09-01T00:40:28,362 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-09-01T00:40:28,363 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml' 2026-09-01T00:40:28,365 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/utils.py' 2026-09-01T00:40:28,366 adding 'lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml' 2026-09-01T00:40:28,368 adding 'lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml' 2026-09-01T00:40:28,369 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-09-01T00:40:28,370 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-09-01T00:40:28,371 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-09-01T00:40:28,372 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml' 2026-09-01T00:40:28,374 adding 'lm_eval/tasks/include/few_shot_en/Bengali/utils.py' 2026-09-01T00:40:28,376 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml' 2026-09-01T00:40:28,377 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml' 2026-09-01T00:40:28,378 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-09-01T00:40:28,379 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-09-01T00:40:28,381 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-09-01T00:40:28,382 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py' 2026-09-01T00:40:28,384 adding 'lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml' 2026-09-01T00:40:28,385 adding 'lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml' 2026-09-01T00:40:28,386 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml' 2026-09-01T00:40:28,387 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-09-01T00:40:28,389 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-09-01T00:40:28,390 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml' 2026-09-01T00:40:28,391 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-09-01T00:40:28,392 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-09-01T00:40:28,394 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml' 2026-09-01T00:40:28,395 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml' 2026-09-01T00:40:28,396 adding 'lm_eval/tasks/include/few_shot_en/Chinese/utils.py' 2026-09-01T00:40:28,398 adding 'lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml' 2026-09-01T00:40:28,399 adding 'lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml' 2026-09-01T00:40:28,400 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-09-01T00:40:28,402 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml' 2026-09-01T00:40:28,403 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml' 2026-09-01T00:40:28,404 adding 'lm_eval/tasks/include/few_shot_en/Croatian/utils.py' 2026-09-01T00:40:28,406 adding 'lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml' 2026-09-01T00:40:28,407 adding 'lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml' 2026-09-01T00:40:28,408 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml' 2026-09-01T00:40:28,410 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-09-01T00:40:28,411 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-09-01T00:40:28,412 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml' 2026-09-01T00:40:28,413 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml' 2026-09-01T00:40:28,414 adding 'lm_eval/tasks/include/few_shot_en/Dutch/utils.py' 2026-09-01T00:40:28,416 adding 'lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml' 2026-09-01T00:40:28,418 adding 'lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml' 2026-09-01T00:40:28,419 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml' 2026-09-01T00:40:28,420 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-09-01T00:40:28,421 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-09-01T00:40:28,422 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml' 2026-09-01T00:40:28,424 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml' 2026-09-01T00:40:28,425 adding 'lm_eval/tasks/include/few_shot_en/Estonian/utils.py' 2026-09-01T00:40:28,427 adding 'lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml' 2026-09-01T00:40:28,428 adding 'lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml' 2026-09-01T00:40:28,430 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml' 2026-09-01T00:40:28,431 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-09-01T00:40:28,432 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-09-01T00:40:28,433 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml' 2026-09-01T00:40:28,434 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml' 2026-09-01T00:40:28,436 adding 'lm_eval/tasks/include/few_shot_en/Finnish/utils.py' 2026-09-01T00:40:28,437 adding 'lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml' 2026-09-01T00:40:28,438 adding 'lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml' 2026-09-01T00:40:28,440 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml' 2026-09-01T00:40:28,441 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml' 2026-09-01T00:40:28,442 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml' 2026-09-01T00:40:28,443 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml' 2026-09-01T00:40:28,444 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml' 2026-09-01T00:40:28,445 adding 'lm_eval/tasks/include/few_shot_en/French/utils.py' 2026-09-01T00:40:28,447 adding 'lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml' 2026-09-01T00:40:28,448 adding 'lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml' 2026-09-01T00:40:28,449 adding 'lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-09-01T00:40:28,450 adding 'lm_eval/tasks/include/few_shot_en/Georgian/utils.py' 2026-09-01T00:40:28,452 adding 'lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml' 2026-09-01T00:40:28,453 adding 'lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml' 2026-09-01T00:40:28,454 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml' 2026-09-01T00:40:28,456 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml' 2026-09-01T00:40:28,457 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml' 2026-09-01T00:40:28,458 adding 'lm_eval/tasks/include/few_shot_en/German/utils.py' 2026-09-01T00:40:28,460 adding 'lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml' 2026-09-01T00:40:28,461 adding 'lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml' 2026-09-01T00:40:28,463 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml' 2026-09-01T00:40:28,464 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml' 2026-09-01T00:40:28,465 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-09-01T00:40:28,466 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml' 2026-09-01T00:40:28,467 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml' 2026-09-01T00:40:28,469 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml' 2026-09-01T00:40:28,470 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml' 2026-09-01T00:40:28,471 adding 'lm_eval/tasks/include/few_shot_en/Greek/utils.py' 2026-09-01T00:40:28,473 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml' 2026-09-01T00:40:28,474 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml' 2026-09-01T00:40:28,475 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-09-01T00:40:28,477 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-09-01T00:40:28,478 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/utils.py' 2026-09-01T00:40:28,480 adding 'lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml' 2026-09-01T00:40:28,481 adding 'lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml' 2026-09-01T00:40:28,483 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml' 2026-09-01T00:40:28,484 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-09-01T00:40:28,485 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml' 2026-09-01T00:40:28,486 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-09-01T00:40:28,487 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-09-01T00:40:28,489 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-09-01T00:40:28,490 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml' 2026-09-01T00:40:28,491 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml' 2026-09-01T00:40:28,492 adding 'lm_eval/tasks/include/few_shot_en/Hindi/utils.py' 2026-09-01T00:40:28,494 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml' 2026-09-01T00:40:28,495 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml' 2026-09-01T00:40:28,496 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-09-01T00:40:28,498 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-09-01T00:40:28,499 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml' 2026-09-01T00:40:28,500 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/utils.py' 2026-09-01T00:40:28,502 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml' 2026-09-01T00:40:28,503 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml' 2026-09-01T00:40:28,504 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-09-01T00:40:28,505 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-09-01T00:40:28,507 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-09-01T00:40:28,508 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-09-01T00:40:28,509 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml' 2026-09-01T00:40:28,510 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/utils.py' 2026-09-01T00:40:28,512 adding 'lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml' 2026-09-01T00:40:28,513 adding 'lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml' 2026-09-01T00:40:28,515 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml' 2026-09-01T00:40:28,516 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml' 2026-09-01T00:40:28,517 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-09-01T00:40:28,518 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml' 2026-09-01T00:40:28,520 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml' 2026-09-01T00:40:28,521 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml' 2026-09-01T00:40:28,522 adding 'lm_eval/tasks/include/few_shot_en/Italian/utils.py' 2026-09-01T00:40:28,524 adding 'lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml' 2026-09-01T00:40:28,525 adding 'lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml' 2026-09-01T00:40:28,527 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml' 2026-09-01T00:40:28,528 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml' 2026-09-01T00:40:28,529 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-09-01T00:40:28,530 adding 'lm_eval/tasks/include/few_shot_en/Japanese/utils.py' 2026-09-01T00:40:28,532 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml' 2026-09-01T00:40:28,533 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml' 2026-09-01T00:40:28,534 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-09-01T00:40:28,535 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/utils.py' 2026-09-01T00:40:28,537 adding 'lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml' 2026-09-01T00:40:28,538 adding 'lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml' 2026-09-01T00:40:28,539 adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml' 2026-09-01T00:40:28,541 adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml' 2026-09-01T00:40:28,542 adding 'lm_eval/tasks/include/few_shot_en/Korean/utils.py' 2026-09-01T00:40:28,544 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml' 2026-09-01T00:40:28,545 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml' 2026-09-01T00:40:28,547 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-09-01T00:40:28,548 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-09-01T00:40:28,549 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-09-01T00:40:28,550 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-09-01T00:40:28,551 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-09-01T00:40:28,553 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py' 2026-09-01T00:40:28,554 adding 'lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml' 2026-09-01T00:40:28,556 adding 'lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml' 2026-09-01T00:40:28,557 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml' 2026-09-01T00:40:28,558 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml' 2026-09-01T00:40:28,559 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml' 2026-09-01T00:40:28,561 adding 'lm_eval/tasks/include/few_shot_en/Malay/utils.py' 2026-09-01T00:40:28,563 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml' 2026-09-01T00:40:28,564 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml' 2026-09-01T00:40:28,565 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-09-01T00:40:28,566 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-09-01T00:40:28,568 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-09-01T00:40:28,569 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-09-01T00:40:28,570 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-09-01T00:40:28,571 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml' 2026-09-01T00:40:28,573 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/utils.py' 2026-09-01T00:40:28,574 adding 'lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml' 2026-09-01T00:40:28,576 adding 'lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml' 2026-09-01T00:40:28,577 adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml' 2026-09-01T00:40:28,578 adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-09-01T00:40:28,579 adding 'lm_eval/tasks/include/few_shot_en/Nepali/utils.py' 2026-09-01T00:40:28,581 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north_macedonian.yaml' 2026-09-01T00:40:28,582 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_north_macedonian_few_shot_en_template_yaml' 2026-09-01T00:40:28,583 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml' 2026-09-01T00:40:28,584 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml' 2026-09-01T00:40:28,585 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_social_science.yaml' 2026-09-01T00:40:28,587 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_stem.yaml' 2026-09-01T00:40:28,588 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py' 2026-09-01T00:40:28,590 adding 'lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml' 2026-09-01T00:40:28,591 adding 'lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml' 2026-09-01T00:40:28,592 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml' 2026-09-01T00:40:28,593 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml' 2026-09-01T00:40:28,594 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml' 2026-09-01T00:40:28,595 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml' 2026-09-01T00:40:28,597 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml' 2026-09-01T00:40:28,598 adding 'lm_eval/tasks/include/few_shot_en/Persian/utils.py' 2026-09-01T00:40:28,600 adding 'lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml' 2026-09-01T00:40:28,601 adding 'lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml' 2026-09-01T00:40:28,602 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml' 2026-09-01T00:40:28,603 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml' 2026-09-01T00:40:28,604 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml' 2026-09-01T00:40:28,606 adding 'lm_eval/tasks/include/few_shot_en/Polish/utils.py' 2026-09-01T00:40:28,607 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml' 2026-09-01T00:40:28,609 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml' 2026-09-01T00:40:28,610 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-09-01T00:40:28,611 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-09-01T00:40:28,612 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-09-01T00:40:28,614 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-09-01T00:40:28,615 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-09-01T00:40:28,616 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml' 2026-09-01T00:40:28,618 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/utils.py' 2026-09-01T00:40:28,619 adding 'lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml' 2026-09-01T00:40:28,621 adding 'lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml' 2026-09-01T00:40:28,622 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml' 2026-09-01T00:40:28,623 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml' 2026-09-01T00:40:28,624 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml' 2026-09-01T00:40:28,625 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml' 2026-09-01T00:40:28,627 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-09-01T00:40:28,628 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml' 2026-09-01T00:40:28,629 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml' 2026-09-01T00:40:28,630 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml' 2026-09-01T00:40:28,631 adding 'lm_eval/tasks/include/few_shot_en/Russian/utils.py' 2026-09-01T00:40:28,633 adding 'lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml' 2026-09-01T00:40:28,634 adding 'lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml' 2026-09-01T00:40:28,635 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-09-01T00:40:28,637 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml' 2026-09-01T00:40:28,638 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml' 2026-09-01T00:40:28,639 adding 'lm_eval/tasks/include/few_shot_en/Serbian/utils.py' 2026-09-01T00:40:28,641 adding 'lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml' 2026-09-01T00:40:28,642 adding 'lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml' 2026-09-01T00:40:28,643 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-09-01T00:40:28,644 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-09-01T00:40:28,646 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml' 2026-09-01T00:40:28,647 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml' 2026-09-01T00:40:28,648 adding 'lm_eval/tasks/include/few_shot_en/Spanish/utils.py' 2026-09-01T00:40:28,650 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml' 2026-09-01T00:40:28,651 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml' 2026-09-01T00:40:28,652 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-09-01T00:40:28,653 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-09-01T00:40:28,654 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/utils.py' 2026-09-01T00:40:28,656 adding 'lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml' 2026-09-01T00:40:28,658 adding 'lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml' 2026-09-01T00:40:28,659 adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-09-01T00:40:28,660 adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml' 2026-09-01T00:40:28,661 adding 'lm_eval/tasks/include/few_shot_en/Tamil/utils.py' 2026-09-01T00:40:28,663 adding 'lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml' 2026-09-01T00:40:28,664 adding 'lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml' 2026-09-01T00:40:28,666 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml' 2026-09-01T00:40:28,667 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-09-01T00:40:28,668 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml' 2026-09-01T00:40:28,669 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml' 2026-09-01T00:40:28,670 adding 'lm_eval/tasks/include/few_shot_en/Telugu/utils.py' 2026-09-01T00:40:28,672 adding 'lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml' 2026-09-01T00:40:28,673 adding 'lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml' 2026-09-01T00:40:28,674 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-09-01T00:40:28,676 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-09-01T00:40:28,677 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml' 2026-09-01T00:40:28,678 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml' 2026-09-01T00:40:28,679 adding 'lm_eval/tasks/include/few_shot_en/Turkish/utils.py' 2026-09-01T00:40:28,681 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml' 2026-09-01T00:40:28,682 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml' 2026-09-01T00:40:28,683 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-09-01T00:40:28,684 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-09-01T00:40:28,686 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-09-01T00:40:28,687 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py' 2026-09-01T00:40:28,689 adding 'lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml' 2026-09-01T00:40:28,690 adding 'lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml' 2026-09-01T00:40:28,691 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-09-01T00:40:28,692 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-09-01T00:40:28,693 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml' 2026-09-01T00:40:28,694 adding 'lm_eval/tasks/include/few_shot_en/Urdu/utils.py' 2026-09-01T00:40:28,696 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml' 2026-09-01T00:40:28,698 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml' 2026-09-01T00:40:28,699 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-09-01T00:40:28,700 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-09-01T00:40:28,701 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-09-01T00:40:28,702 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml' 2026-09-01T00:40:28,703 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/utils.py' 2026-09-01T00:40:28,705 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml' 2026-09-01T00:40:28,706 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml' 2026-09-01T00:40:28,708 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-09-01T00:40:28,709 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-09-01T00:40:28,710 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-09-01T00:40:28,711 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py' 2026-09-01T00:40:28,715 adding 'lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml' 2026-09-01T00:40:28,716 adding 'lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml' 2026-09-01T00:40:28,717 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-09-01T00:40:28,719 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-09-01T00:40:28,720 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-09-01T00:40:28,721 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml' 2026-09-01T00:40:28,722 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml' 2026-09-01T00:40:28,723 adding 'lm_eval/tasks/include/few_shot_og/Albanian/utils.py' 2026-09-01T00:40:28,725 adding 'lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml' 2026-09-01T00:40:28,726 adding 'lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml' 2026-09-01T00:40:28,727 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-09-01T00:40:28,728 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-09-01T00:40:28,730 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml' 2026-09-01T00:40:28,731 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-09-01T00:40:28,732 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml' 2026-09-01T00:40:28,733 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml' 2026-09-01T00:40:28,734 adding 'lm_eval/tasks/include/few_shot_og/Arabic/utils.py' 2026-09-01T00:40:28,736 adding 'lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml' 2026-09-01T00:40:28,737 adding 'lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml' 2026-09-01T00:40:28,738 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-09-01T00:40:28,740 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml' 2026-09-01T00:40:28,741 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml' 2026-09-01T00:40:28,742 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml' 2026-09-01T00:40:28,743 adding 'lm_eval/tasks/include/few_shot_og/Armenian/utils.py' 2026-09-01T00:40:28,745 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml' 2026-09-01T00:40:28,746 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-09-01T00:40:28,747 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-09-01T00:40:28,748 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-09-01T00:40:28,750 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-09-01T00:40:28,751 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-09-01T00:40:28,752 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-09-01T00:40:28,753 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-09-01T00:40:28,754 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py' 2026-09-01T00:40:28,756 adding 'lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml' 2026-09-01T00:40:28,757 adding 'lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml' 2026-09-01T00:40:28,759 adding 'lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml' 2026-09-01T00:40:28,760 adding 'lm_eval/tasks/include/few_shot_og/Basque/utils.py' 2026-09-01T00:40:28,762 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml' 2026-09-01T00:40:28,763 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml' 2026-09-01T00:40:28,764 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-09-01T00:40:28,765 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-09-01T00:40:28,766 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml' 2026-09-01T00:40:28,767 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/utils.py' 2026-09-01T00:40:28,769 adding 'lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml' 2026-09-01T00:40:28,770 adding 'lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml' 2026-09-01T00:40:28,771 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-09-01T00:40:28,773 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-09-01T00:40:28,774 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-09-01T00:40:28,775 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml' 2026-09-01T00:40:28,776 adding 'lm_eval/tasks/include/few_shot_og/Bengali/utils.py' 2026-09-01T00:40:28,778 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml' 2026-09-01T00:40:28,780 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml' 2026-09-01T00:40:28,781 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-09-01T00:40:28,782 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-09-01T00:40:28,783 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-09-01T00:40:28,784 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py' 2026-09-01T00:40:28,786 adding 'lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml' 2026-09-01T00:40:28,787 adding 'lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml' 2026-09-01T00:40:28,789 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml' 2026-09-01T00:40:28,790 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-09-01T00:40:28,791 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-09-01T00:40:28,792 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml' 2026-09-01T00:40:28,793 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-09-01T00:40:28,795 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-09-01T00:40:28,796 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml' 2026-09-01T00:40:28,797 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml' 2026-09-01T00:40:28,798 adding 'lm_eval/tasks/include/few_shot_og/Chinese/utils.py' 2026-09-01T00:40:28,800 adding 'lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml' 2026-09-01T00:40:28,801 adding 'lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml' 2026-09-01T00:40:28,802 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-09-01T00:40:28,804 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml' 2026-09-01T00:40:28,805 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml' 2026-09-01T00:40:28,806 adding 'lm_eval/tasks/include/few_shot_og/Croatian/utils.py' 2026-09-01T00:40:28,808 adding 'lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml' 2026-09-01T00:40:28,809 adding 'lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml' 2026-09-01T00:40:28,810 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml' 2026-09-01T00:40:28,812 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-09-01T00:40:28,813 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-09-01T00:40:28,814 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml' 2026-09-01T00:40:28,815 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml' 2026-09-01T00:40:28,816 adding 'lm_eval/tasks/include/few_shot_og/Dutch/utils.py' 2026-09-01T00:40:28,818 adding 'lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml' 2026-09-01T00:40:28,819 adding 'lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml' 2026-09-01T00:40:28,820 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml' 2026-09-01T00:40:28,821 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-09-01T00:40:28,822 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-09-01T00:40:28,823 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml' 2026-09-01T00:40:28,824 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml' 2026-09-01T00:40:28,826 adding 'lm_eval/tasks/include/few_shot_og/Estonian/utils.py' 2026-09-01T00:40:28,827 adding 'lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml' 2026-09-01T00:40:28,828 adding 'lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml' 2026-09-01T00:40:28,830 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml' 2026-09-01T00:40:28,831 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-09-01T00:40:28,832 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-09-01T00:40:28,833 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml' 2026-09-01T00:40:28,834 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml' 2026-09-01T00:40:28,836 adding 'lm_eval/tasks/include/few_shot_og/Finnish/utils.py' 2026-09-01T00:40:28,837 adding 'lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml' 2026-09-01T00:40:28,839 adding 'lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml' 2026-09-01T00:40:28,840 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml' 2026-09-01T00:40:28,841 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml' 2026-09-01T00:40:28,842 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml' 2026-09-01T00:40:28,843 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml' 2026-09-01T00:40:28,845 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml' 2026-09-01T00:40:28,846 adding 'lm_eval/tasks/include/few_shot_og/French/utils.py' 2026-09-01T00:40:28,848 adding 'lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml' 2026-09-01T00:40:28,849 adding 'lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml' 2026-09-01T00:40:28,850 adding 'lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-09-01T00:40:28,851 adding 'lm_eval/tasks/include/few_shot_og/Georgian/utils.py' 2026-09-01T00:40:28,853 adding 'lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml' 2026-09-01T00:40:28,854 adding 'lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml' 2026-09-01T00:40:28,855 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml' 2026-09-01T00:40:28,857 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml' 2026-09-01T00:40:28,858 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml' 2026-09-01T00:40:28,859 adding 'lm_eval/tasks/include/few_shot_og/German/utils.py' 2026-09-01T00:40:28,861 adding 'lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml' 2026-09-01T00:40:28,862 adding 'lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml' 2026-09-01T00:40:28,863 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml' 2026-09-01T00:40:28,864 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml' 2026-09-01T00:40:28,865 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-09-01T00:40:28,867 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml' 2026-09-01T00:40:28,868 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml' 2026-09-01T00:40:28,869 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml' 2026-09-01T00:40:28,870 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml' 2026-09-01T00:40:28,871 adding 'lm_eval/tasks/include/few_shot_og/Greek/utils.py' 2026-09-01T00:40:28,873 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml' 2026-09-01T00:40:28,874 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml' 2026-09-01T00:40:28,875 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-09-01T00:40:28,876 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-09-01T00:40:28,877 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/utils.py' 2026-09-01T00:40:28,879 adding 'lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml' 2026-09-01T00:40:28,881 adding 'lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml' 2026-09-01T00:40:28,882 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml' 2026-09-01T00:40:28,883 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-09-01T00:40:28,884 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml' 2026-09-01T00:40:28,885 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-09-01T00:40:28,887 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-09-01T00:40:28,888 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-09-01T00:40:28,889 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml' 2026-09-01T00:40:28,890 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml' 2026-09-01T00:40:28,891 adding 'lm_eval/tasks/include/few_shot_og/Hindi/utils.py' 2026-09-01T00:40:28,893 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml' 2026-09-01T00:40:28,894 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml' 2026-09-01T00:40:28,896 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-09-01T00:40:28,897 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-09-01T00:40:28,898 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml' 2026-09-01T00:40:28,899 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/utils.py' 2026-09-01T00:40:28,901 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml' 2026-09-01T00:40:28,902 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml' 2026-09-01T00:40:28,903 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-09-01T00:40:28,905 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-09-01T00:40:28,906 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-09-01T00:40:28,907 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-09-01T00:40:28,908 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml' 2026-09-01T00:40:28,909 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/utils.py' 2026-09-01T00:40:28,911 adding 'lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml' 2026-09-01T00:40:28,912 adding 'lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml' 2026-09-01T00:40:28,913 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml' 2026-09-01T00:40:28,914 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml' 2026-09-01T00:40:28,916 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-09-01T00:40:28,917 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml' 2026-09-01T00:40:28,918 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml' 2026-09-01T00:40:28,919 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml' 2026-09-01T00:40:28,920 adding 'lm_eval/tasks/include/few_shot_og/Italian/utils.py' 2026-09-01T00:40:28,922 adding 'lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml' 2026-09-01T00:40:28,923 adding 'lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml' 2026-09-01T00:40:28,924 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml' 2026-09-01T00:40:28,925 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml' 2026-09-01T00:40:28,927 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-09-01T00:40:28,928 adding 'lm_eval/tasks/include/few_shot_og/Japanese/utils.py' 2026-09-01T00:40:28,930 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml' 2026-09-01T00:40:28,931 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml' 2026-09-01T00:40:28,932 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-09-01T00:40:28,933 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/utils.py' 2026-09-01T00:40:28,935 adding 'lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml' 2026-09-01T00:40:28,936 adding 'lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml' 2026-09-01T00:40:28,938 adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml' 2026-09-01T00:40:28,939 adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml' 2026-09-01T00:40:28,940 adding 'lm_eval/tasks/include/few_shot_og/Korean/utils.py' 2026-09-01T00:40:28,942 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml' 2026-09-01T00:40:28,943 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml' 2026-09-01T00:40:28,944 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-09-01T00:40:28,946 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-09-01T00:40:28,947 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-09-01T00:40:28,948 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-09-01T00:40:28,949 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-09-01T00:40:28,950 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py' 2026-09-01T00:40:28,952 adding 'lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml' 2026-09-01T00:40:28,953 adding 'lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml' 2026-09-01T00:40:28,955 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml' 2026-09-01T00:40:28,956 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml' 2026-09-01T00:40:28,957 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml' 2026-09-01T00:40:28,958 adding 'lm_eval/tasks/include/few_shot_og/Malay/utils.py' 2026-09-01T00:40:28,960 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml' 2026-09-01T00:40:28,961 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml' 2026-09-01T00:40:28,962 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-09-01T00:40:28,963 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-09-01T00:40:28,964 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-09-01T00:40:28,966 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-09-01T00:40:28,967 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-09-01T00:40:28,968 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml' 2026-09-01T00:40:28,969 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/utils.py' 2026-09-01T00:40:28,971 adding 'lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml' 2026-09-01T00:40:28,972 adding 'lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml' 2026-09-01T00:40:28,974 adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml' 2026-09-01T00:40:28,975 adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-09-01T00:40:28,977 adding 'lm_eval/tasks/include/few_shot_og/Nepali/utils.py' 2026-09-01T00:40:28,979 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north_macedonian.yaml' 2026-09-01T00:40:28,980 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_north_macedonian_few_shot_og_template_yaml' 2026-09-01T00:40:28,981 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml' 2026-09-01T00:40:28,982 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml' 2026-09-01T00:40:28,983 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_social_science.yaml' 2026-09-01T00:40:28,985 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_stem.yaml' 2026-09-01T00:40:28,986 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py' 2026-09-01T00:40:28,988 adding 'lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml' 2026-09-01T00:40:28,989 adding 'lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml' 2026-09-01T00:40:28,990 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml' 2026-09-01T00:40:28,991 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml' 2026-09-01T00:40:28,992 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml' 2026-09-01T00:40:28,994 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml' 2026-09-01T00:40:28,995 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml' 2026-09-01T00:40:28,996 adding 'lm_eval/tasks/include/few_shot_og/Persian/utils.py' 2026-09-01T00:40:28,997 adding 'lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml' 2026-09-01T00:40:28,999 adding 'lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml' 2026-09-01T00:40:29,000 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml' 2026-09-01T00:40:29,001 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml' 2026-09-01T00:40:29,002 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml' 2026-09-01T00:40:29,004 adding 'lm_eval/tasks/include/few_shot_og/Polish/utils.py' 2026-09-01T00:40:29,005 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml' 2026-09-01T00:40:29,007 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml' 2026-09-01T00:40:29,008 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-09-01T00:40:29,009 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-09-01T00:40:29,010 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-09-01T00:40:29,011 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-09-01T00:40:29,012 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-09-01T00:40:29,014 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml' 2026-09-01T00:40:29,015 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/utils.py' 2026-09-01T00:40:29,017 adding 'lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml' 2026-09-01T00:40:29,018 adding 'lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml' 2026-09-01T00:40:29,019 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml' 2026-09-01T00:40:29,020 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml' 2026-09-01T00:40:29,021 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml' 2026-09-01T00:40:29,023 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml' 2026-09-01T00:40:29,024 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-09-01T00:40:29,025 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml' 2026-09-01T00:40:29,026 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml' 2026-09-01T00:40:29,027 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml' 2026-09-01T00:40:29,029 adding 'lm_eval/tasks/include/few_shot_og/Russian/utils.py' 2026-09-01T00:40:29,030 adding 'lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml' 2026-09-01T00:40:29,032 adding 'lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml' 2026-09-01T00:40:29,033 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-09-01T00:40:29,034 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml' 2026-09-01T00:40:29,035 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml' 2026-09-01T00:40:29,037 adding 'lm_eval/tasks/include/few_shot_og/Serbian/utils.py' 2026-09-01T00:40:29,038 adding 'lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml' 2026-09-01T00:40:29,039 adding 'lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml' 2026-09-01T00:40:29,041 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-09-01T00:40:29,042 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-09-01T00:40:29,043 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml' 2026-09-01T00:40:29,044 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml' 2026-09-01T00:40:29,045 adding 'lm_eval/tasks/include/few_shot_og/Spanish/utils.py' 2026-09-01T00:40:29,047 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml' 2026-09-01T00:40:29,048 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml' 2026-09-01T00:40:29,049 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-09-01T00:40:29,050 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-09-01T00:40:29,051 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/utils.py' 2026-09-01T00:40:29,053 adding 'lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml' 2026-09-01T00:40:29,054 adding 'lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml' 2026-09-01T00:40:29,055 adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-09-01T00:40:29,057 adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml' 2026-09-01T00:40:29,058 adding 'lm_eval/tasks/include/few_shot_og/Tamil/utils.py' 2026-09-01T00:40:29,060 adding 'lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml' 2026-09-01T00:40:29,061 adding 'lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml' 2026-09-01T00:40:29,062 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml' 2026-09-01T00:40:29,063 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-09-01T00:40:29,064 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml' 2026-09-01T00:40:29,066 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml' 2026-09-01T00:40:29,067 adding 'lm_eval/tasks/include/few_shot_og/Telugu/utils.py' 2026-09-01T00:40:29,069 adding 'lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml' 2026-09-01T00:40:29,070 adding 'lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml' 2026-09-01T00:40:29,071 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-09-01T00:40:29,072 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-09-01T00:40:29,073 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml' 2026-09-01T00:40:29,075 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml' 2026-09-01T00:40:29,076 adding 'lm_eval/tasks/include/few_shot_og/Turkish/utils.py' 2026-09-01T00:40:29,078 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml' 2026-09-01T00:40:29,079 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml' 2026-09-01T00:40:29,080 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-09-01T00:40:29,081 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-09-01T00:40:29,083 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-09-01T00:40:29,084 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py' 2026-09-01T00:40:29,086 adding 'lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml' 2026-09-01T00:40:29,087 adding 'lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml' 2026-09-01T00:40:29,088 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-09-01T00:40:29,089 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-09-01T00:40:29,090 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml' 2026-09-01T00:40:29,091 adding 'lm_eval/tasks/include/few_shot_og/Urdu/utils.py' 2026-09-01T00:40:29,093 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml' 2026-09-01T00:40:29,094 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml' 2026-09-01T00:40:29,096 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-09-01T00:40:29,097 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-09-01T00:40:29,098 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-09-01T00:40:29,100 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml' 2026-09-01T00:40:29,101 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/utils.py' 2026-09-01T00:40:29,103 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml' 2026-09-01T00:40:29,104 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml' 2026-09-01T00:40:29,105 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-09-01T00:40:29,106 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-09-01T00:40:29,107 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-09-01T00:40:29,109 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py' 2026-09-01T00:40:29,111 adding 'lm_eval/tasks/indicparam/README.md' 2026-09-01T00:40:29,112 adding 'lm_eval/tasks/indicparam/_default_indicparam_template_yaml' 2026-09-01T00:40:29,113 adding 'lm_eval/tasks/indicparam/_indicparam.yaml' 2026-09-01T00:40:29,114 adding 'lm_eval/tasks/indicparam/indicparam_bodo.yaml' 2026-09-01T00:40:29,116 adding 'lm_eval/tasks/indicparam/indicparam_dogri.yaml' 2026-09-01T00:40:29,117 adding 'lm_eval/tasks/indicparam/indicparam_gujarati.yaml' 2026-09-01T00:40:29,118 adding 'lm_eval/tasks/indicparam/indicparam_konkani.yaml' 2026-09-01T00:40:29,119 adding 'lm_eval/tasks/indicparam/indicparam_maithili.yaml' 2026-09-01T00:40:29,120 adding 'lm_eval/tasks/indicparam/indicparam_marathi.yaml' 2026-09-01T00:40:29,121 adding 'lm_eval/tasks/indicparam/indicparam_nepali.yaml' 2026-09-01T00:40:29,123 adding 'lm_eval/tasks/indicparam/indicparam_oriya.yaml' 2026-09-01T00:40:29,124 adding 'lm_eval/tasks/indicparam/indicparam_rajasthani.yaml' 2026-09-01T00:40:29,125 adding 'lm_eval/tasks/indicparam/indicparam_sanskrit.yaml' 2026-09-01T00:40:29,126 adding 'lm_eval/tasks/indicparam/indicparam_sanskrit_mix.yaml' 2026-09-01T00:40:29,127 adding 'lm_eval/tasks/indicparam/indicparam_santali.yaml' 2026-09-01T00:40:29,129 adding 'lm_eval/tasks/indicparam/utils.py' 2026-09-01T00:40:29,131 adding 'lm_eval/tasks/indicxnli/README.md' 2026-09-01T00:40:29,132 adding 'lm_eval/tasks/indicxnli/indicxnli_gu.yaml' 2026-09-01T00:40:29,134 adding 'lm_eval/tasks/infinitebench/README.md' 2026-09-01T00:40:29,135 adding 'lm_eval/tasks/infinitebench/_infinitebench_common_yaml' 2026-09-01T00:40:29,137 adding 'lm_eval/tasks/infinitebench/infinitebench.yaml' 2026-09-01T00:40:29,138 adding 'lm_eval/tasks/infinitebench/infinitebench_code_debug.yaml' 2026-09-01T00:40:29,139 adding 'lm_eval/tasks/infinitebench/infinitebench_code_run.yaml' 2026-09-01T00:40:29,140 adding 'lm_eval/tasks/infinitebench/infinitebench_kv_retrieval.yaml' 2026-09-01T00:40:29,142 adding 'lm_eval/tasks/infinitebench/infinitebench_longbook_choice_en.yaml' 2026-09-01T00:40:29,143 adding 'lm_eval/tasks/infinitebench/infinitebench_longbook_qa_chn.yaml' 2026-09-01T00:40:29,145 adding 'lm_eval/tasks/infinitebench/infinitebench_longbook_qa_en.yaml' 2026-09-01T00:40:29,146 adding 'lm_eval/tasks/infinitebench/infinitebench_longbook_sum_en.yaml' 2026-09-01T00:40:29,148 adding 'lm_eval/tasks/infinitebench/infinitebench_longdialogue_qa_en.yaml' 2026-09-01T00:40:29,149 adding 'lm_eval/tasks/infinitebench/infinitebench_math_find.yaml' 2026-09-01T00:40:29,150 adding 'lm_eval/tasks/infinitebench/infinitebench_number_string.yaml' 2026-09-01T00:40:29,151 adding 'lm_eval/tasks/infinitebench/infinitebench_passkey.yaml' 2026-09-01T00:40:29,154 adding 'lm_eval/tasks/infinitebench/utils.py' 2026-09-01T00:40:29,156 adding 'lm_eval/tasks/inverse_scaling/README.md' 2026-09-01T00:40:29,158 adding 'lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml' 2026-09-01T00:40:29,159 adding 'lm_eval/tasks/inverse_scaling/_some_results' 2026-09-01T00:40:29,160 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml' 2026-09-01T00:40:29,161 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml' 2026-09-01T00:40:29,163 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml' 2026-09-01T00:40:29,164 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml' 2026-09-01T00:40:29,165 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml' 2026-09-01T00:40:29,166 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml' 2026-09-01T00:40:29,167 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml' 2026-09-01T00:40:29,168 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml' 2026-09-01T00:40:29,169 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml' 2026-09-01T00:40:29,171 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml' 2026-09-01T00:40:29,172 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml' 2026-09-01T00:40:29,174 adding 'lm_eval/tasks/japanese_leaderboard/README.md' 2026-09-01T00:40:29,175 adding 'lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml' 2026-09-01T00:40:29,177 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml' 2026-09-01T00:40:29,178 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py' 2026-09-01T00:40:29,179 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml' 2026-09-01T00:40:29,181 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml' 2026-09-01T00:40:29,182 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml' 2026-09-01T00:40:29,183 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml' 2026-09-01T00:40:29,184 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py' 2026-09-01T00:40:29,186 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml' 2026-09-01T00:40:29,187 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py' 2026-09-01T00:40:29,188 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml' 2026-09-01T00:40:29,189 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py' 2026-09-01T00:40:29,191 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml' 2026-09-01T00:40:29,192 adding 'lm_eval/tasks/japanese_leaderboard/requirements.txt' 2026-09-01T00:40:29,194 adding 'lm_eval/tasks/jfinqa/README.md' 2026-09-01T00:40:29,195 adding 'lm_eval/tasks/jfinqa/_jfinqa.yaml' 2026-09-01T00:40:29,196 adding 'lm_eval/tasks/jfinqa/jfinqa_consistency.yaml' 2026-09-01T00:40:29,198 adding 'lm_eval/tasks/jfinqa/jfinqa_numerical.yaml' 2026-09-01T00:40:29,199 adding 'lm_eval/tasks/jfinqa/jfinqa_temporal.yaml' 2026-09-01T00:40:29,200 adding 'lm_eval/tasks/jfinqa/test_jfinqa_utils.py' 2026-09-01T00:40:29,202 adding 'lm_eval/tasks/jfinqa/utils.py' 2026-09-01T00:40:29,204 adding 'lm_eval/tasks/jsonschema_bench/README.md' 2026-09-01T00:40:29,206 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml' 2026-09-01T00:40:29,207 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml' 2026-09-01T00:40:29,208 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml' 2026-09-01T00:40:29,209 adding 'lm_eval/tasks/jsonschema_bench/metrics.py' 2026-09-01T00:40:29,211 adding 'lm_eval/tasks/kbl/README.md' 2026-09-01T00:40:29,214 adding 'lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml' 2026-09-01T00:40:29,215 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml' 2026-09-01T00:40:29,217 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml' 2026-09-01T00:40:29,218 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml' 2026-09-01T00:40:29,219 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml' 2026-09-01T00:40:29,220 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml' 2026-09-01T00:40:29,221 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml' 2026-09-01T00:40:29,222 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml' 2026-09-01T00:40:29,223 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml' 2026-09-01T00:40:29,225 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml' 2026-09-01T00:40:29,226 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml' 2026-09-01T00:40:29,227 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml' 2026-09-01T00:40:29,228 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml' 2026-09-01T00:40:29,229 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml' 2026-09-01T00:40:29,230 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml' 2026-09-01T00:40:29,232 adding 'lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml' 2026-09-01T00:40:29,233 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml' 2026-09-01T00:40:29,234 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml' 2026-09-01T00:40:29,236 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml' 2026-09-01T00:40:29,237 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml' 2026-09-01T00:40:29,238 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml' 2026-09-01T00:40:29,239 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml' 2026-09-01T00:40:29,240 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml' 2026-09-01T00:40:29,241 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml' 2026-09-01T00:40:29,243 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml' 2026-09-01T00:40:29,244 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml' 2026-09-01T00:40:29,245 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml' 2026-09-01T00:40:29,246 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml' 2026-09-01T00:40:29,248 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml' 2026-09-01T00:40:29,250 adding 'lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml' 2026-09-01T00:40:29,251 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml' 2026-09-01T00:40:29,252 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml' 2026-09-01T00:40:29,254 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml' 2026-09-01T00:40:29,255 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml' 2026-09-01T00:40:29,256 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml' 2026-09-01T00:40:29,257 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml' 2026-09-01T00:40:29,258 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml' 2026-09-01T00:40:29,259 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml' 2026-09-01T00:40:29,260 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml' 2026-09-01T00:40:29,261 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml' 2026-09-01T00:40:29,263 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml' 2026-09-01T00:40:29,264 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml' 2026-09-01T00:40:29,265 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml' 2026-09-01T00:40:29,267 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml' 2026-09-01T00:40:29,268 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml' 2026-09-01T00:40:29,269 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml' 2026-09-01T00:40:29,270 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml' 2026-09-01T00:40:29,272 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml' 2026-09-01T00:40:29,273 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml' 2026-09-01T00:40:29,274 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml' 2026-09-01T00:40:29,275 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml' 2026-09-01T00:40:29,276 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml' 2026-09-01T00:40:29,277 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml' 2026-09-01T00:40:29,278 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml' 2026-09-01T00:40:29,280 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml' 2026-09-01T00:40:29,281 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml' 2026-09-01T00:40:29,282 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml' 2026-09-01T00:40:29,283 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml' 2026-09-01T00:40:29,285 adding 'lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml' 2026-09-01T00:40:29,286 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml' 2026-09-01T00:40:29,287 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml' 2026-09-01T00:40:29,289 adding 'lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml' 2026-09-01T00:40:29,290 adding 'lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml' 2026-09-01T00:40:29,291 adding 'lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml' 2026-09-01T00:40:29,292 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml' 2026-09-01T00:40:29,294 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml' 2026-09-01T00:40:29,296 adding 'lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml' 2026-09-01T00:40:29,297 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml' 2026-09-01T00:40:29,298 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml' 2026-09-01T00:40:29,299 adding 'lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml' 2026-09-01T00:40:29,300 adding 'lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml' 2026-09-01T00:40:29,302 adding 'lm_eval/tasks/kmmlu/README.md' 2026-09-01T00:40:29,305 adding 'lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml' 2026-09-01T00:40:29,306 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml' 2026-09-01T00:40:29,308 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml' 2026-09-01T00:40:29,309 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml' 2026-09-01T00:40:29,310 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml' 2026-09-01T00:40:29,311 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml' 2026-09-01T00:40:29,313 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml' 2026-09-01T00:40:29,315 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml' 2026-09-01T00:40:29,317 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:40:29,319 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml' 2026-09-01T00:40:29,320 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml' 2026-09-01T00:40:29,322 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml' 2026-09-01T00:40:29,324 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml' 2026-09-01T00:40:29,327 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml' 2026-09-01T00:40:29,329 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml' 2026-09-01T00:40:29,331 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml' 2026-09-01T00:40:29,333 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml' 2026-09-01T00:40:29,335 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml' 2026-09-01T00:40:29,337 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml' 2026-09-01T00:40:29,339 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml' 2026-09-01T00:40:29,341 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml' 2026-09-01T00:40:29,343 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml' 2026-09-01T00:40:29,344 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml' 2026-09-01T00:40:29,346 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml' 2026-09-01T00:40:29,348 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml' 2026-09-01T00:40:29,350 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml' 2026-09-01T00:40:29,352 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml' 2026-09-01T00:40:29,354 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml' 2026-09-01T00:40:29,356 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml' 2026-09-01T00:40:29,357 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml' 2026-09-01T00:40:29,360 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml' 2026-09-01T00:40:29,362 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml' 2026-09-01T00:40:29,364 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml' 2026-09-01T00:40:29,365 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml' 2026-09-01T00:40:29,367 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml' 2026-09-01T00:40:29,369 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml' 2026-09-01T00:40:29,371 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml' 2026-09-01T00:40:29,373 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml' 2026-09-01T00:40:29,375 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml' 2026-09-01T00:40:29,377 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml' 2026-09-01T00:40:29,379 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml' 2026-09-01T00:40:29,381 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml' 2026-09-01T00:40:29,383 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml' 2026-09-01T00:40:29,386 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml' 2026-09-01T00:40:29,388 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml' 2026-09-01T00:40:29,389 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml' 2026-09-01T00:40:29,391 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml' 2026-09-01T00:40:29,393 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml' 2026-09-01T00:40:29,395 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml' 2026-09-01T00:40:29,397 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml' 2026-09-01T00:40:29,399 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:40:29,402 adding 'lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml' 2026-09-01T00:40:29,403 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml' 2026-09-01T00:40:29,404 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml' 2026-09-01T00:40:29,405 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml' 2026-09-01T00:40:29,406 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml' 2026-09-01T00:40:29,407 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml' 2026-09-01T00:40:29,408 adding 'lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml' 2026-09-01T00:40:29,409 adding 'lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml' 2026-09-01T00:40:29,411 adding 'lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:40:29,412 adding 'lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml' 2026-09-01T00:40:29,413 adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml' 2026-09-01T00:40:29,414 adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml' 2026-09-01T00:40:29,415 adding 'lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml' 2026-09-01T00:40:29,416 adding 'lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml' 2026-09-01T00:40:29,417 adding 'lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml' 2026-09-01T00:40:29,419 adding 'lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml' 2026-09-01T00:40:29,420 adding 'lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml' 2026-09-01T00:40:29,421 adding 'lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml' 2026-09-01T00:40:29,422 adding 'lm_eval/tasks/kmmlu/default/kmmlu_education.yaml' 2026-09-01T00:40:29,423 adding 'lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml' 2026-09-01T00:40:29,424 adding 'lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml' 2026-09-01T00:40:29,426 adding 'lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml' 2026-09-01T00:40:29,427 adding 'lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml' 2026-09-01T00:40:29,428 adding 'lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml' 2026-09-01T00:40:29,429 adding 'lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml' 2026-09-01T00:40:29,430 adding 'lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml' 2026-09-01T00:40:29,432 adding 'lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml' 2026-09-01T00:40:29,433 adding 'lm_eval/tasks/kmmlu/default/kmmlu_health.yaml' 2026-09-01T00:40:29,434 adding 'lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml' 2026-09-01T00:40:29,435 adding 'lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml' 2026-09-01T00:40:29,436 adding 'lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml' 2026-09-01T00:40:29,438 adding 'lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml' 2026-09-01T00:40:29,439 adding 'lm_eval/tasks/kmmlu/default/kmmlu_law.yaml' 2026-09-01T00:40:29,440 adding 'lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml' 2026-09-01T00:40:29,441 adding 'lm_eval/tasks/kmmlu/default/kmmlu_management.yaml' 2026-09-01T00:40:29,442 adding 'lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml' 2026-09-01T00:40:29,443 adding 'lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml' 2026-09-01T00:40:29,444 adding 'lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml' 2026-09-01T00:40:29,445 adding 'lm_eval/tasks/kmmlu/default/kmmlu_math.yaml' 2026-09-01T00:40:29,447 adding 'lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml' 2026-09-01T00:40:29,448 adding 'lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml' 2026-09-01T00:40:29,449 adding 'lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml' 2026-09-01T00:40:29,450 adding 'lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml' 2026-09-01T00:40:29,451 adding 'lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml' 2026-09-01T00:40:29,452 adding 'lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml' 2026-09-01T00:40:29,453 adding 'lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml' 2026-09-01T00:40:29,454 adding 'lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml' 2026-09-01T00:40:29,455 adding 'lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml' 2026-09-01T00:40:29,457 adding 'lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml' 2026-09-01T00:40:29,458 adding 'lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml' 2026-09-01T00:40:29,459 adding 'lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:40:29,461 adding 'lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml' 2026-09-01T00:40:29,462 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml' 2026-09-01T00:40:29,464 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml' 2026-09-01T00:40:29,465 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml' 2026-09-01T00:40:29,466 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml' 2026-09-01T00:40:29,467 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml' 2026-09-01T00:40:29,468 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml' 2026-09-01T00:40:29,469 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml' 2026-09-01T00:40:29,471 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:40:29,472 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml' 2026-09-01T00:40:29,473 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml' 2026-09-01T00:40:29,474 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml' 2026-09-01T00:40:29,475 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml' 2026-09-01T00:40:29,476 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml' 2026-09-01T00:40:29,478 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml' 2026-09-01T00:40:29,479 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml' 2026-09-01T00:40:29,480 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml' 2026-09-01T00:40:29,481 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml' 2026-09-01T00:40:29,483 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml' 2026-09-01T00:40:29,484 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml' 2026-09-01T00:40:29,485 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml' 2026-09-01T00:40:29,486 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml' 2026-09-01T00:40:29,487 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml' 2026-09-01T00:40:29,489 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml' 2026-09-01T00:40:29,490 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml' 2026-09-01T00:40:29,491 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml' 2026-09-01T00:40:29,492 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml' 2026-09-01T00:40:29,493 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml' 2026-09-01T00:40:29,495 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml' 2026-09-01T00:40:29,496 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml' 2026-09-01T00:40:29,497 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml' 2026-09-01T00:40:29,498 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml' 2026-09-01T00:40:29,499 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml' 2026-09-01T00:40:29,500 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml' 2026-09-01T00:40:29,501 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml' 2026-09-01T00:40:29,502 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml' 2026-09-01T00:40:29,503 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml' 2026-09-01T00:40:29,505 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml' 2026-09-01T00:40:29,506 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml' 2026-09-01T00:40:29,507 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml' 2026-09-01T00:40:29,508 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml' 2026-09-01T00:40:29,509 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml' 2026-09-01T00:40:29,510 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml' 2026-09-01T00:40:29,511 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml' 2026-09-01T00:40:29,512 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml' 2026-09-01T00:40:29,514 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml' 2026-09-01T00:40:29,515 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml' 2026-09-01T00:40:29,516 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml' 2026-09-01T00:40:29,517 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml' 2026-09-01T00:40:29,518 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml' 2026-09-01T00:40:29,519 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:40:29,522 adding 'lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml' 2026-09-01T00:40:29,523 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml' 2026-09-01T00:40:29,524 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml' 2026-09-01T00:40:29,525 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml' 2026-09-01T00:40:29,527 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml' 2026-09-01T00:40:29,528 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml' 2026-09-01T00:40:29,529 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml' 2026-09-01T00:40:29,530 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml' 2026-09-01T00:40:29,531 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:40:29,532 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml' 2026-09-01T00:40:29,534 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml' 2026-09-01T00:40:29,535 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml' 2026-09-01T00:40:29,536 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml' 2026-09-01T00:40:29,537 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml' 2026-09-01T00:40:29,538 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml' 2026-09-01T00:40:29,540 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml' 2026-09-01T00:40:29,541 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml' 2026-09-01T00:40:29,542 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml' 2026-09-01T00:40:29,543 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml' 2026-09-01T00:40:29,544 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml' 2026-09-01T00:40:29,545 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml' 2026-09-01T00:40:29,547 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml' 2026-09-01T00:40:29,548 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml' 2026-09-01T00:40:29,549 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml' 2026-09-01T00:40:29,550 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml' 2026-09-01T00:40:29,551 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml' 2026-09-01T00:40:29,552 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml' 2026-09-01T00:40:29,554 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml' 2026-09-01T00:40:29,555 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml' 2026-09-01T00:40:29,556 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml' 2026-09-01T00:40:29,557 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml' 2026-09-01T00:40:29,558 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml' 2026-09-01T00:40:29,559 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml' 2026-09-01T00:40:29,560 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml' 2026-09-01T00:40:29,562 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml' 2026-09-01T00:40:29,563 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml' 2026-09-01T00:40:29,564 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml' 2026-09-01T00:40:29,565 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml' 2026-09-01T00:40:29,566 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml' 2026-09-01T00:40:29,568 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml' 2026-09-01T00:40:29,569 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml' 2026-09-01T00:40:29,570 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml' 2026-09-01T00:40:29,571 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml' 2026-09-01T00:40:29,572 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml' 2026-09-01T00:40:29,573 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml' 2026-09-01T00:40:29,574 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml' 2026-09-01T00:40:29,576 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml' 2026-09-01T00:40:29,577 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml' 2026-09-01T00:40:29,578 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml' 2026-09-01T00:40:29,579 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml' 2026-09-01T00:40:29,580 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:40:29,583 adding 'lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml' 2026-09-01T00:40:29,584 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml' 2026-09-01T00:40:29,586 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml' 2026-09-01T00:40:29,587 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml' 2026-09-01T00:40:29,588 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml' 2026-09-01T00:40:29,589 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml' 2026-09-01T00:40:29,590 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml' 2026-09-01T00:40:29,591 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml' 2026-09-01T00:40:29,592 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:40:29,593 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml' 2026-09-01T00:40:29,594 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml' 2026-09-01T00:40:29,596 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml' 2026-09-01T00:40:29,597 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml' 2026-09-01T00:40:29,598 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml' 2026-09-01T00:40:29,599 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml' 2026-09-01T00:40:29,600 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml' 2026-09-01T00:40:29,601 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml' 2026-09-01T00:40:29,602 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml' 2026-09-01T00:40:29,603 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml' 2026-09-01T00:40:29,605 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml' 2026-09-01T00:40:29,606 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml' 2026-09-01T00:40:29,607 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml' 2026-09-01T00:40:29,608 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml' 2026-09-01T00:40:29,609 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml' 2026-09-01T00:40:29,610 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml' 2026-09-01T00:40:29,612 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml' 2026-09-01T00:40:29,613 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml' 2026-09-01T00:40:29,614 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml' 2026-09-01T00:40:29,615 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml' 2026-09-01T00:40:29,616 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml' 2026-09-01T00:40:29,617 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml' 2026-09-01T00:40:29,619 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml' 2026-09-01T00:40:29,620 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml' 2026-09-01T00:40:29,621 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml' 2026-09-01T00:40:29,622 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml' 2026-09-01T00:40:29,623 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml' 2026-09-01T00:40:29,624 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml' 2026-09-01T00:40:29,626 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml' 2026-09-01T00:40:29,627 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml' 2026-09-01T00:40:29,628 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml' 2026-09-01T00:40:29,629 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml' 2026-09-01T00:40:29,630 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml' 2026-09-01T00:40:29,631 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml' 2026-09-01T00:40:29,633 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml' 2026-09-01T00:40:29,634 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml' 2026-09-01T00:40:29,635 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml' 2026-09-01T00:40:29,636 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml' 2026-09-01T00:40:29,637 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml' 2026-09-01T00:40:29,638 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml' 2026-09-01T00:40:29,640 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml' 2026-09-01T00:40:29,641 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:40:29,643 adding 'lm_eval/tasks/kobest/README.md' 2026-09-01T00:40:29,644 adding 'lm_eval/tasks/kobest/_kobest.yaml' 2026-09-01T00:40:29,645 adding 'lm_eval/tasks/kobest/kobest_boolq.yaml' 2026-09-01T00:40:29,646 adding 'lm_eval/tasks/kobest/kobest_copa.yaml' 2026-09-01T00:40:29,647 adding 'lm_eval/tasks/kobest/kobest_hellaswag.yaml' 2026-09-01T00:40:29,648 adding 'lm_eval/tasks/kobest/kobest_sentineg.yaml' 2026-09-01T00:40:29,650 adding 'lm_eval/tasks/kobest/kobest_wic.yaml' 2026-09-01T00:40:29,651 adding 'lm_eval/tasks/kobest/utils.py' 2026-09-01T00:40:29,653 adding 'lm_eval/tasks/kormedmcqa/README.md' 2026-09-01T00:40:29,655 adding 'lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml' 2026-09-01T00:40:29,656 adding 'lm_eval/tasks/kormedmcqa/_template_yaml' 2026-09-01T00:40:29,657 adding 'lm_eval/tasks/kormedmcqa/dentist.yaml' 2026-09-01T00:40:29,658 adding 'lm_eval/tasks/kormedmcqa/doctor.yaml' 2026-09-01T00:40:29,659 adding 'lm_eval/tasks/kormedmcqa/nurse.yaml' 2026-09-01T00:40:29,661 adding 'lm_eval/tasks/kormedmcqa/pharm.yaml' 2026-09-01T00:40:29,662 adding 'lm_eval/tasks/kormedmcqa/utils.py' 2026-09-01T00:40:29,663 adding 'lm_eval/tasks/lambada/README.md' 2026-09-01T00:40:29,665 adding 'lm_eval/tasks/lambada/lambada_openai.yaml' 2026-09-01T00:40:29,666 adding 'lm_eval/tasks/lambada/lambada_standard.yaml' 2026-09-01T00:40:29,668 adding 'lm_eval/tasks/lambada_cloze/README.md' 2026-09-01T00:40:29,669 adding 'lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml' 2026-09-01T00:40:29,670 adding 'lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml' 2026-09-01T00:40:29,672 adding 'lm_eval/tasks/lambada_multilingual/README.md' 2026-09-01T00:40:29,673 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml' 2026-09-01T00:40:29,674 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml' 2026-09-01T00:40:29,676 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml' 2026-09-01T00:40:29,677 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml' 2026-09-01T00:40:29,678 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml' 2026-09-01T00:40:29,680 adding 'lm_eval/tasks/lambada_multilingual_stablelm/README.md' 2026-09-01T00:40:29,681 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml' 2026-09-01T00:40:29,682 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml' 2026-09-01T00:40:29,684 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml' 2026-09-01T00:40:29,685 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml' 2026-09-01T00:40:29,686 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml' 2026-09-01T00:40:29,687 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml' 2026-09-01T00:40:29,688 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml' 2026-09-01T00:40:29,691 adding 'lm_eval/tasks/leaderboard/README.md' 2026-09-01T00:40:29,692 adding 'lm_eval/tasks/leaderboard/leaderboard.yaml' 2026-09-01T00:40:29,695 adding 'lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml' 2026-09-01T00:40:29,696 adding 'lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml' 2026-09-01T00:40:29,697 adding 'lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml' 2026-09-01T00:40:29,699 adding 'lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml' 2026-09-01T00:40:29,700 adding 'lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml' 2026-09-01T00:40:29,701 adding 'lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml' 2026-09-01T00:40:29,703 adding 'lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml' 2026-09-01T00:40:29,704 adding 'lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml' 2026-09-01T00:40:29,706 adding 'lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml' 2026-09-01T00:40:29,707 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml' 2026-09-01T00:40:29,708 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml' 2026-09-01T00:40:29,709 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml' 2026-09-01T00:40:29,711 adding 'lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml' 2026-09-01T00:40:29,712 adding 'lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml' 2026-09-01T00:40:29,713 adding 'lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml' 2026-09-01T00:40:29,714 adding 'lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml' 2026-09-01T00:40:29,715 adding 'lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml' 2026-09-01T00:40:29,717 adding 'lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml' 2026-09-01T00:40:29,718 adding 'lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml' 2026-09-01T00:40:29,720 adding 'lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml' 2026-09-01T00:40:29,721 adding 'lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml' 2026-09-01T00:40:29,723 adding 'lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml' 2026-09-01T00:40:29,724 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:40:29,726 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:40:29,727 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:40:29,729 adding 'lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml' 2026-09-01T00:40:29,731 adding 'lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml' 2026-09-01T00:40:29,732 adding 'lm_eval/tasks/leaderboard/gpqa/_template_yaml' 2026-09-01T00:40:29,734 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml' 2026-09-01T00:40:29,735 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml' 2026-09-01T00:40:29,736 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml' 2026-09-01T00:40:29,737 adding 'lm_eval/tasks/leaderboard/gpqa/utils.py' 2026-09-01T00:40:29,739 adding 'lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml' 2026-09-01T00:40:29,741 adding 'lm_eval/tasks/leaderboard/ifeval/ifeval.yaml' 2026-09-01T00:40:29,746 adding 'lm_eval/tasks/leaderboard/ifeval/instructions.py' 2026-09-01T00:40:29,748 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_registry.py' 2026-09-01T00:40:29,751 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_util.py' 2026-09-01T00:40:29,753 adding 'lm_eval/tasks/leaderboard/ifeval/utils.py' 2026-09-01T00:40:29,754 adding 'lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml' 2026-09-01T00:40:29,756 adding 'lm_eval/tasks/leaderboard/math/_template_yaml' 2026-09-01T00:40:29,757 adding 'lm_eval/tasks/leaderboard/math/math_algebra.yaml' 2026-09-01T00:40:29,758 adding 'lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml' 2026-09-01T00:40:29,759 adding 'lm_eval/tasks/leaderboard/math/math_geometry.yaml' 2026-09-01T00:40:29,760 adding 'lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml' 2026-09-01T00:40:29,762 adding 'lm_eval/tasks/leaderboard/math/math_num_theory.yaml' 2026-09-01T00:40:29,763 adding 'lm_eval/tasks/leaderboard/math/math_prealgebra.yaml' 2026-09-01T00:40:29,764 adding 'lm_eval/tasks/leaderboard/math/math_precalculus.yaml' 2026-09-01T00:40:29,766 adding 'lm_eval/tasks/leaderboard/math/utils.py' 2026-09-01T00:40:29,768 adding 'lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml' 2026-09-01T00:40:29,769 adding 'lm_eval/tasks/leaderboard/mmlu_pro/utils.py' 2026-09-01T00:40:29,771 adding 'lm_eval/tasks/leaderboard/musr/_musr.yaml' 2026-09-01T00:40:29,772 adding 'lm_eval/tasks/leaderboard/musr/_template_yaml' 2026-09-01T00:40:29,773 adding 'lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml' 2026-09-01T00:40:29,774 adding 'lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml' 2026-09-01T00:40:29,775 adding 'lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml' 2026-09-01T00:40:29,776 adding 'lm_eval/tasks/leaderboard/musr/utils.py' 2026-09-01T00:40:29,779 adding 'lm_eval/tasks/legalbench/README.md' 2026-09-01T00:40:29,780 adding 'lm_eval/tasks/legalbench/_contract_nli.yaml' 2026-09-01T00:40:29,781 adding 'lm_eval/tasks/legalbench/_legalbench.yaml' 2026-09-01T00:40:29,782 adding 'lm_eval/tasks/legalbench/_legalbench_template_yaml' 2026-09-01T00:40:29,783 adding 'lm_eval/tasks/legalbench/abercrombie.yaml' 2026-09-01T00:40:29,785 adding 'lm_eval/tasks/legalbench/contract_nli_confidentiality_of_agreement.yaml' 2026-09-01T00:40:29,786 adding 'lm_eval/tasks/legalbench/contract_nli_explicit_identification.yaml' 2026-09-01T00:40:29,787 adding 'lm_eval/tasks/legalbench/contract_nli_inclusion_of_verbally_conveyed_information.yaml' 2026-09-01T00:40:29,788 adding 'lm_eval/tasks/legalbench/contract_nli_limited_use.yaml' 2026-09-01T00:40:29,789 adding 'lm_eval/tasks/legalbench/contract_nli_no_licensing.yaml' 2026-09-01T00:40:29,791 adding 'lm_eval/tasks/legalbench/contract_nli_notice_on_compelled_disclosure.yaml' 2026-09-01T00:40:29,792 adding 'lm_eval/tasks/legalbench/contract_nli_permissible_acquirement_of_similar_information.yaml' 2026-09-01T00:40:29,793 adding 'lm_eval/tasks/legalbench/contract_nli_permissible_copy.yaml' 2026-09-01T00:40:29,794 adding 'lm_eval/tasks/legalbench/contract_nli_permissible_development_of_similar_information.yaml' 2026-09-01T00:40:29,796 adding 'lm_eval/tasks/legalbench/contract_nli_permissible_post-agreement_possession.yaml' 2026-09-01T00:40:29,797 adding 'lm_eval/tasks/legalbench/contract_nli_return_of_confidential_information.yaml' 2026-09-01T00:40:29,798 adding 'lm_eval/tasks/legalbench/contract_nli_sharing_with_employees.yaml' 2026-09-01T00:40:29,799 adding 'lm_eval/tasks/legalbench/contract_nli_sharing_with_third-parties.yaml' 2026-09-01T00:40:29,800 adding 'lm_eval/tasks/legalbench/contract_nli_survival_of_obligations.yaml' 2026-09-01T00:40:29,802 adding 'lm_eval/tasks/legalbench/corporate_lobbying.yaml' 2026-09-01T00:40:29,803 adding 'lm_eval/tasks/legalbench/function_of_decision_section.yaml' 2026-09-01T00:40:29,804 adding 'lm_eval/tasks/legalbench/international_citizenship_questions.yaml' 2026-09-01T00:40:29,805 adding 'lm_eval/tasks/legalbench/proa.yaml' 2026-09-01T00:40:29,808 adding 'lm_eval/tasks/libra/README.md' 2026-09-01T00:40:29,809 adding 'lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml' 2026-09-01T00:40:29,810 adding 'lm_eval/tasks/libra/_multi_hop_question_answering.yaml' 2026-09-01T00:40:29,811 adding 'lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml' 2026-09-01T00:40:29,813 adding 'lm_eval/tasks/libra/_simple_information_retrieval.yaml' 2026-09-01T00:40:29,814 adding 'lm_eval/tasks/libra/_template_yaml' 2026-09-01T00:40:29,815 adding 'lm_eval/tasks/libra/librusec_history.yaml' 2026-09-01T00:40:29,817 adding 'lm_eval/tasks/libra/librusec_mhqa.yaml' 2026-09-01T00:40:29,818 adding 'lm_eval/tasks/libra/long_context_multiq.yaml' 2026-09-01T00:40:29,819 adding 'lm_eval/tasks/libra/matreshka_names.yaml' 2026-09-01T00:40:29,820 adding 'lm_eval/tasks/libra/matreshka_yes_no.yaml' 2026-09-01T00:40:29,822 adding 'lm_eval/tasks/libra/passkey.yaml' 2026-09-01T00:40:29,823 adding 'lm_eval/tasks/libra/passkey_with_librusec.yaml' 2026-09-01T00:40:29,824 adding 'lm_eval/tasks/libra/ru_2wikimultihopqa.yaml' 2026-09-01T00:40:29,825 adding 'lm_eval/tasks/libra/ru_babilong_qa1.yaml' 2026-09-01T00:40:29,827 adding 'lm_eval/tasks/libra/ru_babilong_qa2.yaml' 2026-09-01T00:40:29,828 adding 'lm_eval/tasks/libra/ru_babilong_qa3.yaml' 2026-09-01T00:40:29,829 adding 'lm_eval/tasks/libra/ru_babilong_qa4.yaml' 2026-09-01T00:40:29,831 adding 'lm_eval/tasks/libra/ru_babilong_qa5.yaml' 2026-09-01T00:40:29,832 adding 'lm_eval/tasks/libra/ru_gsm100.yaml' 2026-09-01T00:40:29,833 adding 'lm_eval/tasks/libra/ru_qasper.yaml' 2026-09-01T00:40:29,835 adding 'lm_eval/tasks/libra/ru_quality.yaml' 2026-09-01T00:40:29,836 adding 'lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml' 2026-09-01T00:40:29,837 adding 'lm_eval/tasks/libra/ru_sci_passage_count.yaml' 2026-09-01T00:40:29,839 adding 'lm_eval/tasks/libra/utils.py' 2026-09-01T00:40:29,841 adding 'lm_eval/tasks/lingoly/README.md' 2026-09-01T00:40:29,842 adding 'lm_eval/tasks/lingoly/lingoly_context.yaml' 2026-09-01T00:40:29,843 adding 'lm_eval/tasks/lingoly/lingoly_group.yaml' 2026-09-01T00:40:29,844 adding 'lm_eval/tasks/lingoly/lingoly_nocontext.yaml' 2026-09-01T00:40:29,845 adding 'lm_eval/tasks/lingoly/script.py' 2026-09-01T00:40:29,847 adding 'lm_eval/tasks/lingoly/utils.py' 2026-09-01T00:40:29,849 adding 'lm_eval/tasks/llama3/README.md' 2026-09-01T00:40:29,851 adding 'lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml' 2026-09-01T00:40:29,852 adding 'lm_eval/tasks/llama3/instruct/arc_challenge/utils.py' 2026-09-01T00:40:29,854 adding 'lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml' 2026-09-01T00:40:29,857 adding 'lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml' 2026-09-01T00:40:29,858 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml' 2026-09-01T00:40:29,859 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml' 2026-09-01T00:40:29,860 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml' 2026-09-01T00:40:29,861 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml' 2026-09-01T00:40:29,863 adding 'lm_eval/tasks/llama3/instruct/mmlu/llama.yaml' 2026-09-01T00:40:29,864 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:29,865 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml' 2026-09-01T00:40:29,866 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml' 2026-09-01T00:40:29,867 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml' 2026-09-01T00:40:29,869 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:29,870 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml' 2026-09-01T00:40:29,871 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml' 2026-09-01T00:40:29,872 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml' 2026-09-01T00:40:29,873 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml' 2026-09-01T00:40:29,875 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml' 2026-09-01T00:40:29,876 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml' 2026-09-01T00:40:29,877 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml' 2026-09-01T00:40:29,878 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:29,879 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml' 2026-09-01T00:40:29,880 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:29,882 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:29,883 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml' 2026-09-01T00:40:29,884 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml' 2026-09-01T00:40:29,885 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml' 2026-09-01T00:40:29,887 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:29,888 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:29,889 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:29,890 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml' 2026-09-01T00:40:29,891 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:29,893 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:29,894 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:29,895 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:29,896 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml' 2026-09-01T00:40:29,898 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:29,899 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:29,900 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:29,901 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:29,902 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml' 2026-09-01T00:40:29,903 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml' 2026-09-01T00:40:29,904 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml' 2026-09-01T00:40:29,906 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml' 2026-09-01T00:40:29,907 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:29,908 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml' 2026-09-01T00:40:29,909 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml' 2026-09-01T00:40:29,910 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml' 2026-09-01T00:40:29,911 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml' 2026-09-01T00:40:29,913 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml' 2026-09-01T00:40:29,914 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml' 2026-09-01T00:40:29,915 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:29,916 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml' 2026-09-01T00:40:29,917 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml' 2026-09-01T00:40:29,919 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml' 2026-09-01T00:40:29,920 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml' 2026-09-01T00:40:29,921 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml' 2026-09-01T00:40:29,922 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml' 2026-09-01T00:40:29,923 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml' 2026-09-01T00:40:29,924 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml' 2026-09-01T00:40:29,926 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml' 2026-09-01T00:40:29,927 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml' 2026-09-01T00:40:29,928 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:29,929 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml' 2026-09-01T00:40:29,931 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml' 2026-09-01T00:40:29,933 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml' 2026-09-01T00:40:29,935 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml' 2026-09-01T00:40:29,936 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml' 2026-09-01T00:40:29,937 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml' 2026-09-01T00:40:29,938 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml' 2026-09-01T00:40:29,940 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml' 2026-09-01T00:40:29,941 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:29,942 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml' 2026-09-01T00:40:29,944 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml' 2026-09-01T00:40:29,945 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml' 2026-09-01T00:40:29,946 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:29,948 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml' 2026-09-01T00:40:29,949 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml' 2026-09-01T00:40:29,950 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml' 2026-09-01T00:40:29,951 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml' 2026-09-01T00:40:29,952 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml' 2026-09-01T00:40:29,953 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml' 2026-09-01T00:40:29,954 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml' 2026-09-01T00:40:29,955 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:29,957 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml' 2026-09-01T00:40:29,958 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:29,959 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:29,960 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml' 2026-09-01T00:40:29,961 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml' 2026-09-01T00:40:29,963 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml' 2026-09-01T00:40:29,964 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:29,965 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:29,966 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:29,967 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml' 2026-09-01T00:40:29,968 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:29,969 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:29,971 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:29,972 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:29,973 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml' 2026-09-01T00:40:29,974 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:29,975 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:29,977 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:29,978 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:29,979 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml' 2026-09-01T00:40:29,980 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml' 2026-09-01T00:40:29,981 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml' 2026-09-01T00:40:29,983 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml' 2026-09-01T00:40:29,984 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:29,985 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml' 2026-09-01T00:40:29,986 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml' 2026-09-01T00:40:29,988 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml' 2026-09-01T00:40:29,989 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml' 2026-09-01T00:40:29,990 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml' 2026-09-01T00:40:29,991 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml' 2026-09-01T00:40:29,992 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:29,993 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml' 2026-09-01T00:40:29,994 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml' 2026-09-01T00:40:29,996 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml' 2026-09-01T00:40:29,997 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml' 2026-09-01T00:40:29,998 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml' 2026-09-01T00:40:29,999 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml' 2026-09-01T00:40:30,000 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml' 2026-09-01T00:40:30,001 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml' 2026-09-01T00:40:30,002 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml' 2026-09-01T00:40:30,003 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml' 2026-09-01T00:40:30,005 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:30,006 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml' 2026-09-01T00:40:30,007 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml' 2026-09-01T00:40:30,010 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml' 2026-09-01T00:40:30,011 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml' 2026-09-01T00:40:30,012 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml' 2026-09-01T00:40:30,013 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml' 2026-09-01T00:40:30,014 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml' 2026-09-01T00:40:30,016 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml' 2026-09-01T00:40:30,017 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml' 2026-09-01T00:40:30,018 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml' 2026-09-01T00:40:30,020 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml' 2026-09-01T00:40:30,021 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml' 2026-09-01T00:40:30,022 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml' 2026-09-01T00:40:30,024 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml' 2026-09-01T00:40:30,025 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml' 2026-09-01T00:40:30,027 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml' 2026-09-01T00:40:30,028 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml' 2026-09-01T00:40:30,030 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml' 2026-09-01T00:40:30,031 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml' 2026-09-01T00:40:30,033 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml' 2026-09-01T00:40:30,034 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml' 2026-09-01T00:40:30,036 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml' 2026-09-01T00:40:30,037 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml' 2026-09-01T00:40:30,039 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml' 2026-09-01T00:40:30,040 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml' 2026-09-01T00:40:30,041 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml' 2026-09-01T00:40:30,043 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml' 2026-09-01T00:40:30,044 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml' 2026-09-01T00:40:30,046 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml' 2026-09-01T00:40:30,049 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml' 2026-09-01T00:40:30,051 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml' 2026-09-01T00:40:30,052 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml' 2026-09-01T00:40:30,053 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml' 2026-09-01T00:40:30,055 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml' 2026-09-01T00:40:30,056 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml' 2026-09-01T00:40:30,057 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml' 2026-09-01T00:40:30,059 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml' 2026-09-01T00:40:30,060 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml' 2026-09-01T00:40:30,063 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml' 2026-09-01T00:40:30,064 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml' 2026-09-01T00:40:30,066 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml' 2026-09-01T00:40:30,067 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml' 2026-09-01T00:40:30,069 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml' 2026-09-01T00:40:30,070 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml' 2026-09-01T00:40:30,071 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml' 2026-09-01T00:40:30,073 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml' 2026-09-01T00:40:30,074 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml' 2026-09-01T00:40:30,076 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml' 2026-09-01T00:40:30,077 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml' 2026-09-01T00:40:30,078 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml' 2026-09-01T00:40:30,080 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml' 2026-09-01T00:40:30,081 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml' 2026-09-01T00:40:30,083 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml' 2026-09-01T00:40:30,084 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml' 2026-09-01T00:40:30,086 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml' 2026-09-01T00:40:30,087 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml' 2026-09-01T00:40:30,089 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml' 2026-09-01T00:40:30,091 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml' 2026-09-01T00:40:30,092 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml' 2026-09-01T00:40:30,094 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml' 2026-09-01T00:40:30,095 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml' 2026-09-01T00:40:30,097 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml' 2026-09-01T00:40:30,098 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml' 2026-09-01T00:40:30,099 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml' 2026-09-01T00:40:30,101 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml' 2026-09-01T00:40:30,102 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/utils.py' 2026-09-01T00:40:30,105 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml' 2026-09-01T00:40:30,106 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml' 2026-09-01T00:40:30,107 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml' 2026-09-01T00:40:30,108 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml' 2026-09-01T00:40:30,109 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml' 2026-09-01T00:40:30,111 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml' 2026-09-01T00:40:30,112 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml' 2026-09-01T00:40:30,113 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml' 2026-09-01T00:40:30,115 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml' 2026-09-01T00:40:30,116 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml' 2026-09-01T00:40:30,118 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml' 2026-09-01T00:40:30,119 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml' 2026-09-01T00:40:30,120 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml' 2026-09-01T00:40:30,122 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml' 2026-09-01T00:40:30,123 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml' 2026-09-01T00:40:30,125 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml' 2026-09-01T00:40:30,126 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml' 2026-09-01T00:40:30,128 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml' 2026-09-01T00:40:30,129 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml' 2026-09-01T00:40:30,130 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml' 2026-09-01T00:40:30,132 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml' 2026-09-01T00:40:30,133 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml' 2026-09-01T00:40:30,135 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml' 2026-09-01T00:40:30,136 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml' 2026-09-01T00:40:30,137 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml' 2026-09-01T00:40:30,139 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml' 2026-09-01T00:40:30,140 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml' 2026-09-01T00:40:30,143 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml' 2026-09-01T00:40:30,144 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml' 2026-09-01T00:40:30,146 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml' 2026-09-01T00:40:30,147 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml' 2026-09-01T00:40:30,149 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml' 2026-09-01T00:40:30,150 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml' 2026-09-01T00:40:30,151 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml' 2026-09-01T00:40:30,153 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml' 2026-09-01T00:40:30,154 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml' 2026-09-01T00:40:30,157 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml' 2026-09-01T00:40:30,158 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml' 2026-09-01T00:40:30,160 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml' 2026-09-01T00:40:30,161 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml' 2026-09-01T00:40:30,163 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml' 2026-09-01T00:40:30,164 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml' 2026-09-01T00:40:30,165 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml' 2026-09-01T00:40:30,167 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml' 2026-09-01T00:40:30,168 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml' 2026-09-01T00:40:30,169 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml' 2026-09-01T00:40:30,170 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml' 2026-09-01T00:40:30,172 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml' 2026-09-01T00:40:30,173 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml' 2026-09-01T00:40:30,174 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml' 2026-09-01T00:40:30,176 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml' 2026-09-01T00:40:30,177 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml' 2026-09-01T00:40:30,178 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml' 2026-09-01T00:40:30,180 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml' 2026-09-01T00:40:30,182 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml' 2026-09-01T00:40:30,184 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml' 2026-09-01T00:40:30,185 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml' 2026-09-01T00:40:30,186 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml' 2026-09-01T00:40:30,188 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml' 2026-09-01T00:40:30,189 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml' 2026-09-01T00:40:30,191 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml' 2026-09-01T00:40:30,192 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml' 2026-09-01T00:40:30,193 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml' 2026-09-01T00:40:30,195 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/utils.py' 2026-09-01T00:40:30,198 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml' 2026-09-01T00:40:30,199 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml' 2026-09-01T00:40:30,200 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml' 2026-09-01T00:40:30,201 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml' 2026-09-01T00:40:30,203 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml' 2026-09-01T00:40:30,204 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml' 2026-09-01T00:40:30,205 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml' 2026-09-01T00:40:30,206 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml' 2026-09-01T00:40:30,208 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml' 2026-09-01T00:40:30,209 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml' 2026-09-01T00:40:30,211 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml' 2026-09-01T00:40:30,212 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml' 2026-09-01T00:40:30,214 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml' 2026-09-01T00:40:30,215 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml' 2026-09-01T00:40:30,217 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml' 2026-09-01T00:40:30,218 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml' 2026-09-01T00:40:30,219 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml' 2026-09-01T00:40:30,221 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml' 2026-09-01T00:40:30,222 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml' 2026-09-01T00:40:30,224 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml' 2026-09-01T00:40:30,225 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml' 2026-09-01T00:40:30,226 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml' 2026-09-01T00:40:30,228 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml' 2026-09-01T00:40:30,229 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml' 2026-09-01T00:40:30,230 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml' 2026-09-01T00:40:30,232 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml' 2026-09-01T00:40:30,233 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml' 2026-09-01T00:40:30,236 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml' 2026-09-01T00:40:30,237 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml' 2026-09-01T00:40:30,239 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml' 2026-09-01T00:40:30,240 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml' 2026-09-01T00:40:30,242 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml' 2026-09-01T00:40:30,243 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml' 2026-09-01T00:40:30,244 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml' 2026-09-01T00:40:30,246 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml' 2026-09-01T00:40:30,247 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml' 2026-09-01T00:40:30,250 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml' 2026-09-01T00:40:30,252 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml' 2026-09-01T00:40:30,253 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml' 2026-09-01T00:40:30,254 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml' 2026-09-01T00:40:30,256 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml' 2026-09-01T00:40:30,257 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml' 2026-09-01T00:40:30,258 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml' 2026-09-01T00:40:30,260 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml' 2026-09-01T00:40:30,261 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml' 2026-09-01T00:40:30,263 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml' 2026-09-01T00:40:30,264 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml' 2026-09-01T00:40:30,265 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml' 2026-09-01T00:40:30,267 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml' 2026-09-01T00:40:30,268 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml' 2026-09-01T00:40:30,270 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml' 2026-09-01T00:40:30,271 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml' 2026-09-01T00:40:30,273 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml' 2026-09-01T00:40:30,275 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml' 2026-09-01T00:40:30,277 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml' 2026-09-01T00:40:30,279 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml' 2026-09-01T00:40:30,280 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml' 2026-09-01T00:40:30,282 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml' 2026-09-01T00:40:30,284 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml' 2026-09-01T00:40:30,285 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml' 2026-09-01T00:40:30,286 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml' 2026-09-01T00:40:30,288 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml' 2026-09-01T00:40:30,289 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml' 2026-09-01T00:40:30,290 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py' 2026-09-01T00:40:30,293 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml' 2026-09-01T00:40:30,294 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml' 2026-09-01T00:40:30,295 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml' 2026-09-01T00:40:30,297 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml' 2026-09-01T00:40:30,298 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml' 2026-09-01T00:40:30,299 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml' 2026-09-01T00:40:30,300 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml' 2026-09-01T00:40:30,302 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml' 2026-09-01T00:40:30,304 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml' 2026-09-01T00:40:30,306 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml' 2026-09-01T00:40:30,308 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml' 2026-09-01T00:40:30,310 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml' 2026-09-01T00:40:30,312 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml' 2026-09-01T00:40:30,314 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml' 2026-09-01T00:40:30,316 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml' 2026-09-01T00:40:30,318 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml' 2026-09-01T00:40:30,320 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml' 2026-09-01T00:40:30,322 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml' 2026-09-01T00:40:30,323 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml' 2026-09-01T00:40:30,325 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml' 2026-09-01T00:40:30,327 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml' 2026-09-01T00:40:30,329 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml' 2026-09-01T00:40:30,331 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml' 2026-09-01T00:40:30,332 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml' 2026-09-01T00:40:30,334 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml' 2026-09-01T00:40:30,336 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml' 2026-09-01T00:40:30,338 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml' 2026-09-01T00:40:30,348 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml' 2026-09-01T00:40:30,350 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml' 2026-09-01T00:40:30,352 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml' 2026-09-01T00:40:30,354 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml' 2026-09-01T00:40:30,355 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml' 2026-09-01T00:40:30,357 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml' 2026-09-01T00:40:30,359 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml' 2026-09-01T00:40:30,361 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml' 2026-09-01T00:40:30,363 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml' 2026-09-01T00:40:30,371 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml' 2026-09-01T00:40:30,375 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml' 2026-09-01T00:40:30,377 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml' 2026-09-01T00:40:30,378 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml' 2026-09-01T00:40:30,380 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml' 2026-09-01T00:40:30,382 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml' 2026-09-01T00:40:30,384 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml' 2026-09-01T00:40:30,387 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml' 2026-09-01T00:40:30,388 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml' 2026-09-01T00:40:30,390 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml' 2026-09-01T00:40:30,392 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml' 2026-09-01T00:40:30,394 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml' 2026-09-01T00:40:30,396 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml' 2026-09-01T00:40:30,397 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml' 2026-09-01T00:40:30,400 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml' 2026-09-01T00:40:30,401 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml' 2026-09-01T00:40:30,403 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml' 2026-09-01T00:40:30,406 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml' 2026-09-01T00:40:30,411 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml' 2026-09-01T00:40:30,414 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml' 2026-09-01T00:40:30,417 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml' 2026-09-01T00:40:30,419 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml' 2026-09-01T00:40:30,423 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml' 2026-09-01T00:40:30,425 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml' 2026-09-01T00:40:30,427 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml' 2026-09-01T00:40:30,429 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml' 2026-09-01T00:40:30,431 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml' 2026-09-01T00:40:30,432 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py' 2026-09-01T00:40:30,435 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml' 2026-09-01T00:40:30,436 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml' 2026-09-01T00:40:30,438 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml' 2026-09-01T00:40:30,439 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml' 2026-09-01T00:40:30,440 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml' 2026-09-01T00:40:30,441 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml' 2026-09-01T00:40:30,442 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml' 2026-09-01T00:40:30,444 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml' 2026-09-01T00:40:30,445 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml' 2026-09-01T00:40:30,447 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml' 2026-09-01T00:40:30,448 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml' 2026-09-01T00:40:30,450 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml' 2026-09-01T00:40:30,451 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml' 2026-09-01T00:40:30,452 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml' 2026-09-01T00:40:30,454 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml' 2026-09-01T00:40:30,455 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml' 2026-09-01T00:40:30,456 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml' 2026-09-01T00:40:30,458 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml' 2026-09-01T00:40:30,459 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml' 2026-09-01T00:40:30,460 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml' 2026-09-01T00:40:30,462 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml' 2026-09-01T00:40:30,463 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml' 2026-09-01T00:40:30,464 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml' 2026-09-01T00:40:30,466 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml' 2026-09-01T00:40:30,467 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml' 2026-09-01T00:40:30,468 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml' 2026-09-01T00:40:30,470 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml' 2026-09-01T00:40:30,472 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml' 2026-09-01T00:40:30,474 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml' 2026-09-01T00:40:30,475 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml' 2026-09-01T00:40:30,476 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml' 2026-09-01T00:40:30,478 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml' 2026-09-01T00:40:30,479 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml' 2026-09-01T00:40:30,480 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml' 2026-09-01T00:40:30,482 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml' 2026-09-01T00:40:30,483 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml' 2026-09-01T00:40:30,486 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml' 2026-09-01T00:40:30,487 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml' 2026-09-01T00:40:30,489 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml' 2026-09-01T00:40:30,490 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml' 2026-09-01T00:40:30,491 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml' 2026-09-01T00:40:30,493 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml' 2026-09-01T00:40:30,494 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml' 2026-09-01T00:40:30,496 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml' 2026-09-01T00:40:30,497 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml' 2026-09-01T00:40:30,498 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml' 2026-09-01T00:40:30,500 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml' 2026-09-01T00:40:30,501 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml' 2026-09-01T00:40:30,502 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml' 2026-09-01T00:40:30,504 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml' 2026-09-01T00:40:30,505 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml' 2026-09-01T00:40:30,507 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml' 2026-09-01T00:40:30,508 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml' 2026-09-01T00:40:30,509 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml' 2026-09-01T00:40:30,511 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml' 2026-09-01T00:40:30,512 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml' 2026-09-01T00:40:30,514 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml' 2026-09-01T00:40:30,515 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml' 2026-09-01T00:40:30,517 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml' 2026-09-01T00:40:30,518 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml' 2026-09-01T00:40:30,520 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml' 2026-09-01T00:40:30,521 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml' 2026-09-01T00:40:30,522 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml' 2026-09-01T00:40:30,523 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/utils.py' 2026-09-01T00:40:30,526 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml' 2026-09-01T00:40:30,527 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml' 2026-09-01T00:40:30,528 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml' 2026-09-01T00:40:30,529 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml' 2026-09-01T00:40:30,530 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml' 2026-09-01T00:40:30,531 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml' 2026-09-01T00:40:30,532 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml' 2026-09-01T00:40:30,534 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml' 2026-09-01T00:40:30,535 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml' 2026-09-01T00:40:30,536 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml' 2026-09-01T00:40:30,537 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml' 2026-09-01T00:40:30,538 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml' 2026-09-01T00:40:30,539 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml' 2026-09-01T00:40:30,540 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml' 2026-09-01T00:40:30,541 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml' 2026-09-01T00:40:30,543 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml' 2026-09-01T00:40:30,544 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py' 2026-09-01T00:40:30,547 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml' 2026-09-01T00:40:30,548 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml' 2026-09-01T00:40:30,549 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml' 2026-09-01T00:40:30,550 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml' 2026-09-01T00:40:30,552 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml' 2026-09-01T00:40:30,553 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml' 2026-09-01T00:40:30,554 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml' 2026-09-01T00:40:30,555 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml' 2026-09-01T00:40:30,557 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml' 2026-09-01T00:40:30,558 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml' 2026-09-01T00:40:30,560 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml' 2026-09-01T00:40:30,561 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml' 2026-09-01T00:40:30,563 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml' 2026-09-01T00:40:30,564 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml' 2026-09-01T00:40:30,565 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml' 2026-09-01T00:40:30,567 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml' 2026-09-01T00:40:30,568 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml' 2026-09-01T00:40:30,569 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml' 2026-09-01T00:40:30,571 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml' 2026-09-01T00:40:30,572 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml' 2026-09-01T00:40:30,573 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml' 2026-09-01T00:40:30,575 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml' 2026-09-01T00:40:30,576 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml' 2026-09-01T00:40:30,577 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml' 2026-09-01T00:40:30,578 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml' 2026-09-01T00:40:30,580 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml' 2026-09-01T00:40:30,581 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml' 2026-09-01T00:40:30,584 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml' 2026-09-01T00:40:30,585 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml' 2026-09-01T00:40:30,587 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml' 2026-09-01T00:40:30,588 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml' 2026-09-01T00:40:30,589 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml' 2026-09-01T00:40:30,591 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml' 2026-09-01T00:40:30,592 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml' 2026-09-01T00:40:30,593 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml' 2026-09-01T00:40:30,595 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml' 2026-09-01T00:40:30,597 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml' 2026-09-01T00:40:30,599 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml' 2026-09-01T00:40:30,600 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml' 2026-09-01T00:40:30,602 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml' 2026-09-01T00:40:30,603 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml' 2026-09-01T00:40:30,604 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml' 2026-09-01T00:40:30,606 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml' 2026-09-01T00:40:30,607 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml' 2026-09-01T00:40:30,608 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml' 2026-09-01T00:40:30,610 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml' 2026-09-01T00:40:30,611 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml' 2026-09-01T00:40:30,612 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml' 2026-09-01T00:40:30,614 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml' 2026-09-01T00:40:30,615 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml' 2026-09-01T00:40:30,617 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml' 2026-09-01T00:40:30,618 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml' 2026-09-01T00:40:30,619 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml' 2026-09-01T00:40:30,620 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml' 2026-09-01T00:40:30,622 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml' 2026-09-01T00:40:30,624 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml' 2026-09-01T00:40:30,625 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml' 2026-09-01T00:40:30,626 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml' 2026-09-01T00:40:30,628 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml' 2026-09-01T00:40:30,630 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml' 2026-09-01T00:40:30,631 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml' 2026-09-01T00:40:30,632 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml' 2026-09-01T00:40:30,633 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml' 2026-09-01T00:40:30,635 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py' 2026-09-01T00:40:30,637 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml' 2026-09-01T00:40:30,639 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml' 2026-09-01T00:40:30,640 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml' 2026-09-01T00:40:30,641 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml' 2026-09-01T00:40:30,642 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml' 2026-09-01T00:40:30,643 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml' 2026-09-01T00:40:30,645 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml' 2026-09-01T00:40:30,646 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml' 2026-09-01T00:40:30,648 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml' 2026-09-01T00:40:30,651 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml' 2026-09-01T00:40:30,652 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml' 2026-09-01T00:40:30,654 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml' 2026-09-01T00:40:30,656 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml' 2026-09-01T00:40:30,658 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml' 2026-09-01T00:40:30,660 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml' 2026-09-01T00:40:30,662 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml' 2026-09-01T00:40:30,664 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml' 2026-09-01T00:40:30,666 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml' 2026-09-01T00:40:30,667 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml' 2026-09-01T00:40:30,669 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml' 2026-09-01T00:40:30,671 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml' 2026-09-01T00:40:30,673 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml' 2026-09-01T00:40:30,675 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml' 2026-09-01T00:40:30,676 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml' 2026-09-01T00:40:30,678 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml' 2026-09-01T00:40:30,680 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml' 2026-09-01T00:40:30,682 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml' 2026-09-01T00:40:30,692 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml' 2026-09-01T00:40:30,694 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml' 2026-09-01T00:40:30,696 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml' 2026-09-01T00:40:30,698 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml' 2026-09-01T00:40:30,699 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml' 2026-09-01T00:40:30,701 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml' 2026-09-01T00:40:30,703 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml' 2026-09-01T00:40:30,705 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml' 2026-09-01T00:40:30,707 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml' 2026-09-01T00:40:30,715 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml' 2026-09-01T00:40:30,719 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml' 2026-09-01T00:40:30,721 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml' 2026-09-01T00:40:30,722 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml' 2026-09-01T00:40:30,725 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml' 2026-09-01T00:40:30,727 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml' 2026-09-01T00:40:30,728 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml' 2026-09-01T00:40:30,731 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml' 2026-09-01T00:40:30,732 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml' 2026-09-01T00:40:30,734 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml' 2026-09-01T00:40:30,736 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml' 2026-09-01T00:40:30,737 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml' 2026-09-01T00:40:30,739 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml' 2026-09-01T00:40:30,741 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml' 2026-09-01T00:40:30,743 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml' 2026-09-01T00:40:30,745 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml' 2026-09-01T00:40:30,747 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml' 2026-09-01T00:40:30,750 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml' 2026-09-01T00:40:30,758 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml' 2026-09-01T00:40:30,761 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml' 2026-09-01T00:40:30,764 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml' 2026-09-01T00:40:30,766 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml' 2026-09-01T00:40:30,770 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml' 2026-09-01T00:40:30,772 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml' 2026-09-01T00:40:30,774 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml' 2026-09-01T00:40:30,776 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml' 2026-09-01T00:40:30,778 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml' 2026-09-01T00:40:30,779 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/utils.py' 2026-09-01T00:40:30,784 adding 'lm_eval/tasks/lm_syneval/README.md' 2026-09-01T00:40:30,785 adding 'lm_eval/tasks/lm_syneval/_template_yaml' 2026-09-01T00:40:30,786 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml' 2026-09-01T00:40:30,787 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml' 2026-09-01T00:40:30,788 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml' 2026-09-01T00:40:30,789 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml' 2026-09-01T00:40:30,790 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml' 2026-09-01T00:40:30,792 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml' 2026-09-01T00:40:30,793 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml' 2026-09-01T00:40:30,794 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml' 2026-09-01T00:40:30,795 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml' 2026-09-01T00:40:30,796 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml' 2026-09-01T00:40:30,798 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml' 2026-09-01T00:40:30,799 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml' 2026-09-01T00:40:30,800 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml' 2026-09-01T00:40:30,801 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml' 2026-09-01T00:40:30,802 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml' 2026-09-01T00:40:30,803 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml' 2026-09-01T00:40:30,804 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml' 2026-09-01T00:40:30,806 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml' 2026-09-01T00:40:30,807 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml' 2026-09-01T00:40:30,808 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml' 2026-09-01T00:40:30,809 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml' 2026-09-01T00:40:30,810 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml' 2026-09-01T00:40:30,811 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml' 2026-09-01T00:40:30,813 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml' 2026-09-01T00:40:30,814 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml' 2026-09-01T00:40:30,815 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml' 2026-09-01T00:40:30,816 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml' 2026-09-01T00:40:30,817 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml' 2026-09-01T00:40:30,818 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml' 2026-09-01T00:40:30,820 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml' 2026-09-01T00:40:30,821 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml' 2026-09-01T00:40:30,822 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml' 2026-09-01T00:40:30,823 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml' 2026-09-01T00:40:30,824 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml' 2026-09-01T00:40:30,825 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml' 2026-09-01T00:40:30,826 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml' 2026-09-01T00:40:30,827 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml' 2026-09-01T00:40:30,829 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml' 2026-09-01T00:40:30,830 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml' 2026-09-01T00:40:30,831 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml' 2026-09-01T00:40:30,832 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml' 2026-09-01T00:40:30,833 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml' 2026-09-01T00:40:30,834 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml' 2026-09-01T00:40:30,835 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml' 2026-09-01T00:40:30,837 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml' 2026-09-01T00:40:30,838 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml' 2026-09-01T00:40:30,839 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml' 2026-09-01T00:40:30,840 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml' 2026-09-01T00:40:30,841 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml' 2026-09-01T00:40:30,842 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml' 2026-09-01T00:40:30,843 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml' 2026-09-01T00:40:30,845 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml' 2026-09-01T00:40:30,846 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml' 2026-09-01T00:40:30,847 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml' 2026-09-01T00:40:30,848 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml' 2026-09-01T00:40:30,849 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml' 2026-09-01T00:40:30,850 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml' 2026-09-01T00:40:30,852 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml' 2026-09-01T00:40:30,853 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml' 2026-09-01T00:40:30,854 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml' 2026-09-01T00:40:30,855 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml' 2026-09-01T00:40:30,856 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml' 2026-09-01T00:40:30,858 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml' 2026-09-01T00:40:30,859 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml' 2026-09-01T00:40:30,860 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml' 2026-09-01T00:40:30,861 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml' 2026-09-01T00:40:30,862 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml' 2026-09-01T00:40:30,863 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml' 2026-09-01T00:40:30,864 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml' 2026-09-01T00:40:30,865 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml' 2026-09-01T00:40:30,866 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml' 2026-09-01T00:40:30,867 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml' 2026-09-01T00:40:30,869 adding 'lm_eval/tasks/lm_syneval/lm_syneval_group.yaml' 2026-09-01T00:40:30,871 adding 'lm_eval/tasks/logiqa/README.md' 2026-09-01T00:40:30,872 adding 'lm_eval/tasks/logiqa/logiqa.yaml' 2026-09-01T00:40:30,873 adding 'lm_eval/tasks/logiqa/utils_logiqa.py' 2026-09-01T00:40:30,875 adding 'lm_eval/tasks/logiqa2/README.md' 2026-09-01T00:40:30,876 adding 'lm_eval/tasks/logiqa2/logieval.yaml' 2026-09-01T00:40:30,878 adding 'lm_eval/tasks/logiqa2/logiqa2.yaml' 2026-09-01T00:40:30,879 adding 'lm_eval/tasks/logiqa2/utils_logiqa2.py' 2026-09-01T00:40:30,881 adding 'lm_eval/tasks/longbench/2wikimqa.yaml' 2026-09-01T00:40:30,883 adding 'lm_eval/tasks/longbench/2wikimqa_e.yaml' 2026-09-01T00:40:30,884 adding 'lm_eval/tasks/longbench/README.md' 2026-09-01T00:40:30,886 adding 'lm_eval/tasks/longbench/_generate_config.py' 2026-09-01T00:40:30,887 adding 'lm_eval/tasks/longbench/_longbench.yaml' 2026-09-01T00:40:30,889 adding 'lm_eval/tasks/longbench/_longbench_code.yaml' 2026-09-01T00:40:30,890 adding 'lm_eval/tasks/longbench/_longbench_code_e.yaml' 2026-09-01T00:40:30,891 adding 'lm_eval/tasks/longbench/_longbench_e.yaml' 2026-09-01T00:40:30,892 adding 'lm_eval/tasks/longbench/_longbench_fewshot.yaml' 2026-09-01T00:40:30,893 adding 'lm_eval/tasks/longbench/_longbench_fewshot_e.yaml' 2026-09-01T00:40:30,894 adding 'lm_eval/tasks/longbench/_longbench_multi.yaml' 2026-09-01T00:40:30,896 adding 'lm_eval/tasks/longbench/_longbench_multi_e.yaml' 2026-09-01T00:40:30,897 adding 'lm_eval/tasks/longbench/_longbench_single.yaml' 2026-09-01T00:40:30,898 adding 'lm_eval/tasks/longbench/_longbench_single_e.yaml' 2026-09-01T00:40:30,899 adding 'lm_eval/tasks/longbench/_longbench_summarization.yaml' 2026-09-01T00:40:30,900 adding 'lm_eval/tasks/longbench/_longbench_summarization_e.yaml' 2026-09-01T00:40:30,901 adding 'lm_eval/tasks/longbench/_longbench_synthetic.yaml' 2026-09-01T00:40:30,903 adding 'lm_eval/tasks/longbench/_longbench_synthetic_e.yaml' 2026-09-01T00:40:30,904 adding 'lm_eval/tasks/longbench/dureader.yaml' 2026-09-01T00:40:30,905 adding 'lm_eval/tasks/longbench/gov_report.yaml' 2026-09-01T00:40:30,906 adding 'lm_eval/tasks/longbench/gov_report_e.yaml' 2026-09-01T00:40:30,908 adding 'lm_eval/tasks/longbench/hotpotqa.yaml' 2026-09-01T00:40:30,909 adding 'lm_eval/tasks/longbench/hotpotqa_e.yaml' 2026-09-01T00:40:30,910 adding 'lm_eval/tasks/longbench/lcc.yaml' 2026-09-01T00:40:30,911 adding 'lm_eval/tasks/longbench/lcc_e.yaml' 2026-09-01T00:40:30,913 adding 'lm_eval/tasks/longbench/lsht.yaml' 2026-09-01T00:40:30,914 adding 'lm_eval/tasks/longbench/metrics.py' 2026-09-01T00:40:30,916 adding 'lm_eval/tasks/longbench/multi_news.yaml' 2026-09-01T00:40:30,917 adding 'lm_eval/tasks/longbench/multi_news_e.yaml' 2026-09-01T00:40:30,918 adding 'lm_eval/tasks/longbench/multifieldqa_en.yaml' 2026-09-01T00:40:30,920 adding 'lm_eval/tasks/longbench/multifieldqa_en_e.yaml' 2026-09-01T00:40:30,921 adding 'lm_eval/tasks/longbench/multifieldqa_zh.yaml' 2026-09-01T00:40:30,922 adding 'lm_eval/tasks/longbench/musique.yaml' 2026-09-01T00:40:30,924 adding 'lm_eval/tasks/longbench/narrativeqa.yaml' 2026-09-01T00:40:30,925 adding 'lm_eval/tasks/longbench/passage_count.yaml' 2026-09-01T00:40:30,926 adding 'lm_eval/tasks/longbench/passage_count_e.yaml' 2026-09-01T00:40:30,927 adding 'lm_eval/tasks/longbench/passage_retrieval_en.yaml' 2026-09-01T00:40:30,928 adding 'lm_eval/tasks/longbench/passage_retrieval_en_e.yaml' 2026-09-01T00:40:30,930 adding 'lm_eval/tasks/longbench/passage_retrieval_zh.yaml' 2026-09-01T00:40:30,931 adding 'lm_eval/tasks/longbench/qasper.yaml' 2026-09-01T00:40:30,932 adding 'lm_eval/tasks/longbench/qasper_e.yaml' 2026-09-01T00:40:30,933 adding 'lm_eval/tasks/longbench/qmsum.yaml' 2026-09-01T00:40:30,934 adding 'lm_eval/tasks/longbench/repobench-p.yaml' 2026-09-01T00:40:30,935 adding 'lm_eval/tasks/longbench/repobench-p_e.yaml' 2026-09-01T00:40:30,937 adding 'lm_eval/tasks/longbench/samsum.yaml' 2026-09-01T00:40:30,938 adding 'lm_eval/tasks/longbench/samsum_e.yaml' 2026-09-01T00:40:30,939 adding 'lm_eval/tasks/longbench/trec.yaml' 2026-09-01T00:40:30,941 adding 'lm_eval/tasks/longbench/trec_e.yaml' 2026-09-01T00:40:30,942 adding 'lm_eval/tasks/longbench/triviaqa.yaml' 2026-09-01T00:40:30,943 adding 'lm_eval/tasks/longbench/triviaqa_e.yaml' 2026-09-01T00:40:30,944 adding 'lm_eval/tasks/longbench/utils.py' 2026-09-01T00:40:30,946 adding 'lm_eval/tasks/longbench/vcsum.yaml' 2026-09-01T00:40:30,948 adding 'lm_eval/tasks/longbench2/README.md' 2026-09-01T00:40:30,949 adding 'lm_eval/tasks/longbench2/_longbench2.yaml' 2026-09-01T00:40:30,950 adding 'lm_eval/tasks/longbench2/_longbench2_history.yaml' 2026-09-01T00:40:30,951 adding 'lm_eval/tasks/longbench2/_longbench2_incontext.yaml' 2026-09-01T00:40:30,953 adding 'lm_eval/tasks/longbench2/_longbench2_multi.yaml' 2026-09-01T00:40:30,954 adding 'lm_eval/tasks/longbench2/_longbench2_single.yaml' 2026-09-01T00:40:30,955 adding 'lm_eval/tasks/longbench2/_longbench2_structured.yaml' 2026-09-01T00:40:30,956 adding 'lm_eval/tasks/longbench2/_longbench_common_yaml' 2026-09-01T00:40:30,957 adding 'lm_eval/tasks/longbench2/academic_multi_doc.yaml' 2026-09-01T00:40:30,959 adding 'lm_eval/tasks/longbench2/academic_single.yaml' 2026-09-01T00:40:30,960 adding 'lm_eval/tasks/longbench2/agent_history.yaml' 2026-09-01T00:40:30,961 adding 'lm_eval/tasks/longbench2/detective.yaml' 2026-09-01T00:40:30,962 adding 'lm_eval/tasks/longbench2/dialogue_history.yaml' 2026-09-01T00:40:30,963 adding 'lm_eval/tasks/longbench2/event_order.yaml' 2026-09-01T00:40:30,964 adding 'lm_eval/tasks/longbench2/fin_multi_doc.yaml' 2026-09-01T00:40:30,966 adding 'lm_eval/tasks/longbench2/fin_single_doc.yaml' 2026-09-01T00:40:30,967 adding 'lm_eval/tasks/longbench2/govt_multi_doc.yaml' 2026-09-01T00:40:30,968 adding 'lm_eval/tasks/longbench2/govt_single_doc.yaml' 2026-09-01T00:40:30,969 adding 'lm_eval/tasks/longbench2/graph.yaml' 2026-09-01T00:40:30,970 adding 'lm_eval/tasks/longbench2/legal_multi.yaml' 2026-09-01T00:40:30,971 adding 'lm_eval/tasks/longbench2/legal_single.yaml' 2026-09-01T00:40:30,972 adding 'lm_eval/tasks/longbench2/lit_single_doc.yaml' 2026-09-01T00:40:30,974 adding 'lm_eval/tasks/longbench2/longbench2_code.yaml' 2026-09-01T00:40:30,975 adding 'lm_eval/tasks/longbench2/many_shot.yaml' 2026-09-01T00:40:30,976 adding 'lm_eval/tasks/longbench2/news_multi.yaml' 2026-09-01T00:40:30,977 adding 'lm_eval/tasks/longbench2/table.yaml' 2026-09-01T00:40:30,979 adding 'lm_eval/tasks/longbench2/translate.yaml' 2026-09-01T00:40:30,980 adding 'lm_eval/tasks/longbench2/user_guide.yaml' 2026-09-01T00:40:30,982 adding 'lm_eval/tasks/longproc/README.md' 2026-09-01T00:40:30,983 adding 'lm_eval/tasks/longproc/_default_yaml_0.5k' 2026-09-01T00:40:30,985 adding 'lm_eval/tasks/longproc/_default_yaml_2k' 2026-09-01T00:40:30,986 adding 'lm_eval/tasks/longproc/_default_yaml_8k' 2026-09-01T00:40:30,987 adding 'lm_eval/tasks/longproc/_longproc.yaml' 2026-09-01T00:40:30,988 adding 'lm_eval/tasks/longproc/_longproc_countdown.yaml' 2026-09-01T00:40:30,989 adding 'lm_eval/tasks/longproc/_longproc_html_to_tsv.yaml' 2026-09-01T00:40:30,990 adding 'lm_eval/tasks/longproc/_longproc_path_traversal.yaml' 2026-09-01T00:40:30,991 adding 'lm_eval/tasks/longproc/_longproc_pseudo_to_code.yaml' 2026-09-01T00:40:30,993 adding 'lm_eval/tasks/longproc/_longproc_tom_tracking.yaml' 2026-09-01T00:40:30,994 adding 'lm_eval/tasks/longproc/_longproc_travel_planning.yaml' 2026-09-01T00:40:30,995 adding 'lm_eval/tasks/longproc/countdown_0.5k.yaml' 2026-09-01T00:40:30,996 adding 'lm_eval/tasks/longproc/countdown_2k.yaml' 2026-09-01T00:40:30,997 adding 'lm_eval/tasks/longproc/countdown_8k.yaml' 2026-09-01T00:40:30,998 adding 'lm_eval/tasks/longproc/html_to_tsv_0.5k.yaml' 2026-09-01T00:40:30,999 adding 'lm_eval/tasks/longproc/html_to_tsv_2k.yaml' 2026-09-01T00:40:31,000 adding 'lm_eval/tasks/longproc/html_to_tsv_8k.yaml' 2026-09-01T00:40:31,003 adding 'lm_eval/tasks/longproc/metrics.py' 2026-09-01T00:40:31,004 adding 'lm_eval/tasks/longproc/path_traversal_0.5k.yaml' 2026-09-01T00:40:31,005 adding 'lm_eval/tasks/longproc/path_traversal_2k.yaml' 2026-09-01T00:40:31,007 adding 'lm_eval/tasks/longproc/path_traversal_8k.yaml' 2026-09-01T00:40:31,008 adding 'lm_eval/tasks/longproc/pseudo_to_code_0.5k.yaml' 2026-09-01T00:40:31,009 adding 'lm_eval/tasks/longproc/pseudo_to_code_2k.yaml' 2026-09-01T00:40:31,010 adding 'lm_eval/tasks/longproc/tom_tracking_0.5k.yaml' 2026-09-01T00:40:31,011 adding 'lm_eval/tasks/longproc/tom_tracking_2k.yaml' 2026-09-01T00:40:31,012 adding 'lm_eval/tasks/longproc/tom_tracking_8k.yaml' 2026-09-01T00:40:31,013 adding 'lm_eval/tasks/longproc/travel_planning_2k.yaml' 2026-09-01T00:40:31,014 adding 'lm_eval/tasks/longproc/travel_planning_8k.yaml' 2026-09-01T00:40:31,016 adding 'lm_eval/tasks/longproc/utils.py' 2026-09-01T00:40:31,018 adding 'lm_eval/tasks/mastermind/README.md' 2026-09-01T00:40:31,019 adding 'lm_eval/tasks/mastermind/mastermind_24_easy.yaml' 2026-09-01T00:40:31,020 adding 'lm_eval/tasks/mastermind/mastermind_24_hard.yaml' 2026-09-01T00:40:31,021 adding 'lm_eval/tasks/mastermind/mastermind_35_easy.yaml' 2026-09-01T00:40:31,022 adding 'lm_eval/tasks/mastermind/mastermind_35_hard.yaml' 2026-09-01T00:40:31,023 adding 'lm_eval/tasks/mastermind/mastermind_46_easy.yaml' 2026-09-01T00:40:31,025 adding 'lm_eval/tasks/mastermind/mastermind_46_hard.yaml' 2026-09-01T00:40:31,027 adding 'lm_eval/tasks/mathqa/README.md' 2026-09-01T00:40:31,028 adding 'lm_eval/tasks/mathqa/mathqa.yaml' 2026-09-01T00:40:31,029 adding 'lm_eval/tasks/mathqa/utils.py' 2026-09-01T00:40:31,031 adding 'lm_eval/tasks/mbpp/README.md' 2026-09-01T00:40:31,032 adding 'lm_eval/tasks/mbpp/mbpp.yaml' 2026-09-01T00:40:31,034 adding 'lm_eval/tasks/mbpp/mbpp_instruct.yaml' 2026-09-01T00:40:31,035 adding 'lm_eval/tasks/mbpp/mbpp_plus.yaml' 2026-09-01T00:40:31,036 adding 'lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml' 2026-09-01T00:40:31,038 adding 'lm_eval/tasks/mbpp/utils.py' 2026-09-01T00:40:31,040 adding 'lm_eval/tasks/mc_taco/README.md' 2026-09-01T00:40:31,041 adding 'lm_eval/tasks/mc_taco/default.yaml' 2026-09-01T00:40:31,043 adding 'lm_eval/tasks/med_concepts_qa/README.md' 2026-09-01T00:40:31,045 adding 'lm_eval/tasks/med_concepts_qa/_default_template_yaml' 2026-09-01T00:40:31,046 adding 'lm_eval/tasks/med_concepts_qa/_generate_configs.py' 2026-09-01T00:40:31,047 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml' 2026-09-01T00:40:31,048 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml' 2026-09-01T00:40:31,049 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml' 2026-09-01T00:40:31,051 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml' 2026-09-01T00:40:31,052 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml' 2026-09-01T00:40:31,053 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml' 2026-09-01T00:40:31,054 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml' 2026-09-01T00:40:31,055 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml' 2026-09-01T00:40:31,056 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml' 2026-09-01T00:40:31,057 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml' 2026-09-01T00:40:31,058 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml' 2026-09-01T00:40:31,059 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml' 2026-09-01T00:40:31,061 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml' 2026-09-01T00:40:31,062 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml' 2026-09-01T00:40:31,063 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml' 2026-09-01T00:40:31,064 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml' 2026-09-01T00:40:31,065 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml' 2026-09-01T00:40:31,066 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml' 2026-09-01T00:40:31,067 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml' 2026-09-01T00:40:31,069 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml' 2026-09-01T00:40:31,070 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml' 2026-09-01T00:40:31,071 adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml' 2026-09-01T00:40:31,072 adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml' 2026-09-01T00:40:31,083 adding 'lm_eval/tasks/med_prescriptions/utils.py' 2026-09-01T00:40:31,086 adding 'lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml' 2026-09-01T00:40:31,087 adding 'lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml' 2026-09-01T00:40:31,088 adding 'lm_eval/tasks/med_text_classification/utils.py' 2026-09-01T00:40:31,090 adding 'lm_eval/tasks/meddialog/README.md' 2026-09-01T00:40:31,092 adding 'lm_eval/tasks/meddialog/meddialog_qsumm.yaml' 2026-09-01T00:40:31,093 adding 'lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml' 2026-09-01T00:40:31,094 adding 'lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml' 2026-09-01T00:40:31,095 adding 'lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml' 2026-09-01T00:40:31,097 adding 'lm_eval/tasks/meddialog/utils.py' 2026-09-01T00:40:31,098 adding 'lm_eval/tasks/meddialog/utils_perplexity.py' 2026-09-01T00:40:31,100 adding 'lm_eval/tasks/mediqa_qa2019/README.md' 2026-09-01T00:40:31,102 adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml' 2026-09-01T00:40:31,103 adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml' 2026-09-01T00:40:31,104 adding 'lm_eval/tasks/mediqa_qa2019/utils.py' 2026-09-01T00:40:31,105 adding 'lm_eval/tasks/mediqa_qa2019/utils_perplexity.py' 2026-09-01T00:40:31,107 adding 'lm_eval/tasks/medmcqa/medmcqa.yaml' 2026-09-01T00:40:31,108 adding 'lm_eval/tasks/medmcqa/utils_medmcqa.py' 2026-09-01T00:40:31,110 adding 'lm_eval/tasks/medqa/medqa.yaml' 2026-09-01T00:40:31,111 adding 'lm_eval/tasks/medqa/preprocess_medqa.py' 2026-09-01T00:40:31,113 adding 'lm_eval/tasks/medtext/README.md' 2026-09-01T00:40:31,114 adding 'lm_eval/tasks/medtext/medtext.yaml' 2026-09-01T00:40:31,116 adding 'lm_eval/tasks/medtext/medtext_perplexity.yaml' 2026-09-01T00:40:31,117 adding 'lm_eval/tasks/medtext/utils.py' 2026-09-01T00:40:31,118 adding 'lm_eval/tasks/medtext/utils_perplexity.py' 2026-09-01T00:40:31,120 adding 'lm_eval/tasks/mela/README.md' 2026-09-01T00:40:31,121 adding 'lm_eval/tasks/mela/_mela.yaml' 2026-09-01T00:40:31,123 adding 'lm_eval/tasks/mela/mela_ar.yaml' 2026-09-01T00:40:31,124 adding 'lm_eval/tasks/mela/mela_de.yaml' 2026-09-01T00:40:31,125 adding 'lm_eval/tasks/mela/mela_en.yaml' 2026-09-01T00:40:31,126 adding 'lm_eval/tasks/mela/mela_es.yaml' 2026-09-01T00:40:31,128 adding 'lm_eval/tasks/mela/mela_fr.yaml' 2026-09-01T00:40:31,129 adding 'lm_eval/tasks/mela/mela_is.yaml' 2026-09-01T00:40:31,130 adding 'lm_eval/tasks/mela/mela_it.yaml' 2026-09-01T00:40:31,131 adding 'lm_eval/tasks/mela/mela_ja.yaml' 2026-09-01T00:40:31,132 adding 'lm_eval/tasks/mela/mela_ru.yaml' 2026-09-01T00:40:31,133 adding 'lm_eval/tasks/mela/mela_zh.yaml' 2026-09-01T00:40:31,134 adding 'lm_eval/tasks/meqsum/README.md' 2026-09-01T00:40:31,136 adding 'lm_eval/tasks/meqsum/meqsum.yaml' 2026-09-01T00:40:31,137 adding 'lm_eval/tasks/meqsum/utils.py' 2026-09-01T00:40:31,140 adding 'lm_eval/tasks/metabench/README.md' 2026-09-01T00:40:31,141 adding 'lm_eval/tasks/metabench/metabench.yaml' 2026-09-01T00:40:31,142 adding 'lm_eval/tasks/metabench/metabench_arc.yaml' 2026-09-01T00:40:31,143 adding 'lm_eval/tasks/metabench/metabench_arc_permute.yaml' 2026-09-01T00:40:31,144 adding 'lm_eval/tasks/metabench/metabench_arc_secondary.yaml' 2026-09-01T00:40:31,145 adding 'lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml' 2026-09-01T00:40:31,147 adding 'lm_eval/tasks/metabench/metabench_gsm8k.yaml' 2026-09-01T00:40:31,148 adding 'lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml' 2026-09-01T00:40:31,149 adding 'lm_eval/tasks/metabench/metabench_hellaswag.yaml' 2026-09-01T00:40:31,150 adding 'lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml' 2026-09-01T00:40:31,151 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml' 2026-09-01T00:40:31,152 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml' 2026-09-01T00:40:31,153 adding 'lm_eval/tasks/metabench/metabench_mmlu.yaml' 2026-09-01T00:40:31,154 adding 'lm_eval/tasks/metabench/metabench_mmlu_permute.yaml' 2026-09-01T00:40:31,155 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml' 2026-09-01T00:40:31,157 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml' 2026-09-01T00:40:31,158 adding 'lm_eval/tasks/metabench/metabench_permute.yaml' 2026-09-01T00:40:31,159 adding 'lm_eval/tasks/metabench/metabench_secondary.yaml' 2026-09-01T00:40:31,160 adding 'lm_eval/tasks/metabench/metabench_secondary_permute.yaml' 2026-09-01T00:40:31,161 adding 'lm_eval/tasks/metabench/metabench_truthfulqa.yaml' 2026-09-01T00:40:31,163 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml' 2026-09-01T00:40:31,164 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml' 2026-09-01T00:40:31,165 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml' 2026-09-01T00:40:31,166 adding 'lm_eval/tasks/metabench/metabench_winogrande.yaml' 2026-09-01T00:40:31,167 adding 'lm_eval/tasks/metabench/metabench_winogrande_permute.yaml' 2026-09-01T00:40:31,169 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml' 2026-09-01T00:40:31,170 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml' 2026-09-01T00:40:31,171 adding 'lm_eval/tasks/metabench/process_docs.py' 2026-09-01T00:40:31,173 adding 'lm_eval/tasks/metabench/process_docs_permute.py' 2026-09-01T00:40:31,175 adding 'lm_eval/tasks/mgsm/README.md' 2026-09-01T00:40:31,176 adding 'lm_eval/tasks/mgsm/gen_yaml.sh' 2026-09-01T00:40:31,178 adding 'lm_eval/tasks/mgsm/utils.py' 2026-09-01T00:40:31,180 adding 'lm_eval/tasks/mgsm/direct/direct_yaml' 2026-09-01T00:40:31,181 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml' 2026-09-01T00:40:31,183 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml' 2026-09-01T00:40:31,184 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml' 2026-09-01T00:40:31,185 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml' 2026-09-01T00:40:31,187 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml' 2026-09-01T00:40:31,188 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml' 2026-09-01T00:40:31,189 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml' 2026-09-01T00:40:31,190 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml' 2026-09-01T00:40:31,191 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml' 2026-09-01T00:40:31,193 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml' 2026-09-01T00:40:31,194 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml' 2026-09-01T00:40:31,196 adding 'lm_eval/tasks/mgsm/en_cot/cot_yaml' 2026-09-01T00:40:31,197 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml' 2026-09-01T00:40:31,198 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml' 2026-09-01T00:40:31,199 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml' 2026-09-01T00:40:31,200 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml' 2026-09-01T00:40:31,201 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml' 2026-09-01T00:40:31,202 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml' 2026-09-01T00:40:31,204 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml' 2026-09-01T00:40:31,205 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml' 2026-09-01T00:40:31,206 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml' 2026-09-01T00:40:31,207 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml' 2026-09-01T00:40:31,208 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml' 2026-09-01T00:40:31,210 adding 'lm_eval/tasks/mgsm/native_cot/cot_yaml' 2026-09-01T00:40:31,211 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml' 2026-09-01T00:40:31,213 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml' 2026-09-01T00:40:31,214 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml' 2026-09-01T00:40:31,215 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml' 2026-09-01T00:40:31,216 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml' 2026-09-01T00:40:31,218 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml' 2026-09-01T00:40:31,219 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml' 2026-09-01T00:40:31,220 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml' 2026-09-01T00:40:31,221 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml' 2026-09-01T00:40:31,222 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml' 2026-09-01T00:40:31,224 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml' 2026-09-01T00:40:31,226 adding 'lm_eval/tasks/mimic_repsum/README.md' 2026-09-01T00:40:31,227 adding 'lm_eval/tasks/mimic_repsum/mimic_repsum.yaml' 2026-09-01T00:40:31,228 adding 'lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml' 2026-09-01T00:40:31,230 adding 'lm_eval/tasks/mimic_repsum/utils.py' 2026-09-01T00:40:31,231 adding 'lm_eval/tasks/mimic_repsum/utils_perplexity.py' 2026-09-01T00:40:31,233 adding 'lm_eval/tasks/minerva_math/README.md' 2026-09-01T00:40:31,234 adding 'lm_eval/tasks/minerva_math/minerva_math500.yaml' 2026-09-01T00:40:31,236 adding 'lm_eval/tasks/minerva_math/minerva_math_algebra.yaml' 2026-09-01T00:40:31,237 adding 'lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml' 2026-09-01T00:40:31,238 adding 'lm_eval/tasks/minerva_math/minerva_math_geometry.yaml' 2026-09-01T00:40:31,239 adding 'lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml' 2026-09-01T00:40:31,240 adding 'lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml' 2026-09-01T00:40:31,242 adding 'lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml' 2026-09-01T00:40:31,243 adding 'lm_eval/tasks/minerva_math/minerva_math_precalc.yaml' 2026-09-01T00:40:31,245 adding 'lm_eval/tasks/minerva_math/utils.py' 2026-09-01T00:40:31,248 adding 'lm_eval/tasks/mlqa/README.md' 2026-09-01T00:40:31,249 adding 'lm_eval/tasks/mlqa/generate_tasks.py' 2026-09-01T00:40:31,251 adding 'lm_eval/tasks/mlqa/mlqa_ar_ar.yaml' 2026-09-01T00:40:31,252 adding 'lm_eval/tasks/mlqa/mlqa_ar_de.yaml' 2026-09-01T00:40:31,253 adding 'lm_eval/tasks/mlqa/mlqa_ar_en.yaml' 2026-09-01T00:40:31,254 adding 'lm_eval/tasks/mlqa/mlqa_ar_es.yaml' 2026-09-01T00:40:31,256 adding 'lm_eval/tasks/mlqa/mlqa_ar_hi.yaml' 2026-09-01T00:40:31,257 adding 'lm_eval/tasks/mlqa/mlqa_ar_vi.yaml' 2026-09-01T00:40:31,258 adding 'lm_eval/tasks/mlqa/mlqa_ar_zh.yaml' 2026-09-01T00:40:31,259 adding 'lm_eval/tasks/mlqa/mlqa_common_yaml' 2026-09-01T00:40:31,260 adding 'lm_eval/tasks/mlqa/mlqa_de_ar.yaml' 2026-09-01T00:40:31,261 adding 'lm_eval/tasks/mlqa/mlqa_de_de.yaml' 2026-09-01T00:40:31,263 adding 'lm_eval/tasks/mlqa/mlqa_de_en.yaml' 2026-09-01T00:40:31,264 adding 'lm_eval/tasks/mlqa/mlqa_de_es.yaml' 2026-09-01T00:40:31,265 adding 'lm_eval/tasks/mlqa/mlqa_de_hi.yaml' 2026-09-01T00:40:31,266 adding 'lm_eval/tasks/mlqa/mlqa_de_vi.yaml' 2026-09-01T00:40:31,267 adding 'lm_eval/tasks/mlqa/mlqa_de_zh.yaml' 2026-09-01T00:40:31,268 adding 'lm_eval/tasks/mlqa/mlqa_en_ar.yaml' 2026-09-01T00:40:31,269 adding 'lm_eval/tasks/mlqa/mlqa_en_de.yaml' 2026-09-01T00:40:31,270 adding 'lm_eval/tasks/mlqa/mlqa_en_en.yaml' 2026-09-01T00:40:31,271 adding 'lm_eval/tasks/mlqa/mlqa_en_es.yaml' 2026-09-01T00:40:31,273 adding 'lm_eval/tasks/mlqa/mlqa_en_hi.yaml' 2026-09-01T00:40:31,274 adding 'lm_eval/tasks/mlqa/mlqa_en_vi.yaml' 2026-09-01T00:40:31,275 adding 'lm_eval/tasks/mlqa/mlqa_en_zh.yaml' 2026-09-01T00:40:31,276 adding 'lm_eval/tasks/mlqa/mlqa_es_ar.yaml' 2026-09-01T00:40:31,277 adding 'lm_eval/tasks/mlqa/mlqa_es_de.yaml' 2026-09-01T00:40:31,279 adding 'lm_eval/tasks/mlqa/mlqa_es_en.yaml' 2026-09-01T00:40:31,280 adding 'lm_eval/tasks/mlqa/mlqa_es_es.yaml' 2026-09-01T00:40:31,281 adding 'lm_eval/tasks/mlqa/mlqa_es_hi.yaml' 2026-09-01T00:40:31,282 adding 'lm_eval/tasks/mlqa/mlqa_es_vi.yaml' 2026-09-01T00:40:31,283 adding 'lm_eval/tasks/mlqa/mlqa_es_zh.yaml' 2026-09-01T00:40:31,284 adding 'lm_eval/tasks/mlqa/mlqa_hi_ar.yaml' 2026-09-01T00:40:31,285 adding 'lm_eval/tasks/mlqa/mlqa_hi_de.yaml' 2026-09-01T00:40:31,286 adding 'lm_eval/tasks/mlqa/mlqa_hi_en.yaml' 2026-09-01T00:40:31,288 adding 'lm_eval/tasks/mlqa/mlqa_hi_es.yaml' 2026-09-01T00:40:31,289 adding 'lm_eval/tasks/mlqa/mlqa_hi_hi.yaml' 2026-09-01T00:40:31,290 adding 'lm_eval/tasks/mlqa/mlqa_hi_vi.yaml' 2026-09-01T00:40:31,291 adding 'lm_eval/tasks/mlqa/mlqa_hi_zh.yaml' 2026-09-01T00:40:31,292 adding 'lm_eval/tasks/mlqa/mlqa_vi_ar.yaml' 2026-09-01T00:40:31,293 adding 'lm_eval/tasks/mlqa/mlqa_vi_de.yaml' 2026-09-01T00:40:31,294 adding 'lm_eval/tasks/mlqa/mlqa_vi_en.yaml' 2026-09-01T00:40:31,296 adding 'lm_eval/tasks/mlqa/mlqa_vi_es.yaml' 2026-09-01T00:40:31,297 adding 'lm_eval/tasks/mlqa/mlqa_vi_hi.yaml' 2026-09-01T00:40:31,298 adding 'lm_eval/tasks/mlqa/mlqa_vi_vi.yaml' 2026-09-01T00:40:31,299 adding 'lm_eval/tasks/mlqa/mlqa_vi_zh.yaml' 2026-09-01T00:40:31,300 adding 'lm_eval/tasks/mlqa/mlqa_zh_ar.yaml' 2026-09-01T00:40:31,301 adding 'lm_eval/tasks/mlqa/mlqa_zh_de.yaml' 2026-09-01T00:40:31,303 adding 'lm_eval/tasks/mlqa/mlqa_zh_en.yaml' 2026-09-01T00:40:31,304 adding 'lm_eval/tasks/mlqa/mlqa_zh_es.yaml' 2026-09-01T00:40:31,305 adding 'lm_eval/tasks/mlqa/mlqa_zh_hi.yaml' 2026-09-01T00:40:31,306 adding 'lm_eval/tasks/mlqa/mlqa_zh_vi.yaml' 2026-09-01T00:40:31,307 adding 'lm_eval/tasks/mlqa/mlqa_zh_zh.yaml' 2026-09-01T00:40:31,309 adding 'lm_eval/tasks/mlqa/utils.py' 2026-09-01T00:40:31,311 adding 'lm_eval/tasks/mmlu/README.md' 2026-09-01T00:40:31,312 adding 'lm_eval/tasks/mmlu/_generate_configs.py' 2026-09-01T00:40:31,315 adding 'lm_eval/tasks/mmlu/continuation/_continuation_template_yaml' 2026-09-01T00:40:31,317 adding 'lm_eval/tasks/mmlu/continuation/_mmlu.yaml' 2026-09-01T00:40:31,318 adding 'lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,319 adding 'lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml' 2026-09-01T00:40:31,320 adding 'lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml' 2026-09-01T00:40:31,321 adding 'lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,323 adding 'lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,324 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml' 2026-09-01T00:40:31,325 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,326 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,328 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,329 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,330 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml' 2026-09-01T00:40:31,331 adding 'lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml' 2026-09-01T00:40:31,332 adding 'lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:31,333 adding 'lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml' 2026-09-01T00:40:31,334 adding 'lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:31,335 adding 'lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:31,336 adding 'lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml' 2026-09-01T00:40:31,337 adding 'lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml' 2026-09-01T00:40:31,339 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml' 2026-09-01T00:40:31,340 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:31,341 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:31,342 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:31,343 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml' 2026-09-01T00:40:31,345 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:31,346 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:31,347 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:31,348 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:31,349 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml' 2026-09-01T00:40:31,350 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:31,352 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:31,353 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:31,354 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:31,355 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml' 2026-09-01T00:40:31,356 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml' 2026-09-01T00:40:31,357 adding 'lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml' 2026-09-01T00:40:31,359 adding 'lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml' 2026-09-01T00:40:31,360 adding 'lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:31,361 adding 'lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml' 2026-09-01T00:40:31,362 adding 'lm_eval/tasks/mmlu/continuation/mmlu_management.yaml' 2026-09-01T00:40:31,363 adding 'lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml' 2026-09-01T00:40:31,365 adding 'lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml' 2026-09-01T00:40:31,366 adding 'lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml' 2026-09-01T00:40:31,367 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml' 2026-09-01T00:40:31,368 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:31,369 adding 'lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml' 2026-09-01T00:40:31,371 adding 'lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml' 2026-09-01T00:40:31,372 adding 'lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml' 2026-09-01T00:40:31,373 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml' 2026-09-01T00:40:31,374 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml' 2026-09-01T00:40:31,375 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml' 2026-09-01T00:40:31,377 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml' 2026-09-01T00:40:31,378 adding 'lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml' 2026-09-01T00:40:31,379 adding 'lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml' 2026-09-01T00:40:31,380 adding 'lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml' 2026-09-01T00:40:31,381 adding 'lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:31,382 adding 'lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml' 2026-09-01T00:40:31,383 adding 'lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml' 2026-09-01T00:40:31,386 adding 'lm_eval/tasks/mmlu/default/_default_template_yaml' 2026-09-01T00:40:31,387 adding 'lm_eval/tasks/mmlu/default/_mmlu.yaml' 2026-09-01T00:40:31,388 adding 'lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml' 2026-09-01T00:40:31,389 adding 'lm_eval/tasks/mmlu/default/_mmlu_other.yaml' 2026-09-01T00:40:31,390 adding 'lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml' 2026-09-01T00:40:31,391 adding 'lm_eval/tasks/mmlu/default/_mmlu_stem.yaml' 2026-09-01T00:40:31,393 adding 'lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,394 adding 'lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml' 2026-09-01T00:40:31,395 adding 'lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml' 2026-09-01T00:40:31,396 adding 'lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,397 adding 'lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,398 adding 'lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml' 2026-09-01T00:40:31,399 adding 'lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,400 adding 'lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,401 adding 'lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,403 adding 'lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,404 adding 'lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml' 2026-09-01T00:40:31,405 adding 'lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml' 2026-09-01T00:40:31,406 adding 'lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:31,407 adding 'lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml' 2026-09-01T00:40:31,409 adding 'lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:31,410 adding 'lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:31,411 adding 'lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml' 2026-09-01T00:40:31,412 adding 'lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml' 2026-09-01T00:40:31,413 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml' 2026-09-01T00:40:31,414 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:31,416 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:31,417 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:31,418 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml' 2026-09-01T00:40:31,419 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:31,420 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:31,422 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:31,423 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:31,424 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml' 2026-09-01T00:40:31,425 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:31,427 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:31,428 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:31,429 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:31,430 adding 'lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml' 2026-09-01T00:40:31,431 adding 'lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml' 2026-09-01T00:40:31,433 adding 'lm_eval/tasks/mmlu/default/mmlu_international_law.yaml' 2026-09-01T00:40:31,434 adding 'lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml' 2026-09-01T00:40:31,435 adding 'lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:31,436 adding 'lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml' 2026-09-01T00:40:31,437 adding 'lm_eval/tasks/mmlu/default/mmlu_management.yaml' 2026-09-01T00:40:31,438 adding 'lm_eval/tasks/mmlu/default/mmlu_marketing.yaml' 2026-09-01T00:40:31,439 adding 'lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml' 2026-09-01T00:40:31,440 adding 'lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml' 2026-09-01T00:40:31,441 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml' 2026-09-01T00:40:31,442 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:31,444 adding 'lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml' 2026-09-01T00:40:31,445 adding 'lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml' 2026-09-01T00:40:31,446 adding 'lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml' 2026-09-01T00:40:31,447 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml' 2026-09-01T00:40:31,448 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml' 2026-09-01T00:40:31,449 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml' 2026-09-01T00:40:31,450 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml' 2026-09-01T00:40:31,451 adding 'lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml' 2026-09-01T00:40:31,453 adding 'lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml' 2026-09-01T00:40:31,454 adding 'lm_eval/tasks/mmlu/default/mmlu_sociology.yaml' 2026-09-01T00:40:31,455 adding 'lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:31,456 adding 'lm_eval/tasks/mmlu/default/mmlu_virology.yaml' 2026-09-01T00:40:31,457 adding 'lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml' 2026-09-01T00:40:31,497 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json' 2026-09-01T00:40:31,500 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml' 2026-09-01T00:40:31,501 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml' 2026-09-01T00:40:31,502 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,504 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml' 2026-09-01T00:40:31,505 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml' 2026-09-01T00:40:31,507 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,508 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,510 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml' 2026-09-01T00:40:31,511 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,513 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,515 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,516 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,517 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml' 2026-09-01T00:40:31,519 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml' 2026-09-01T00:40:31,520 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:31,522 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml' 2026-09-01T00:40:31,523 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:31,525 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:31,527 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml' 2026-09-01T00:40:31,528 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml' 2026-09-01T00:40:31,529 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml' 2026-09-01T00:40:31,531 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:31,532 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:31,535 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:31,536 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml' 2026-09-01T00:40:31,538 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:31,539 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:31,540 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:31,542 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:31,543 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml' 2026-09-01T00:40:31,545 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:31,546 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:31,548 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:31,550 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:31,551 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml' 2026-09-01T00:40:31,553 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml' 2026-09-01T00:40:31,554 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml' 2026-09-01T00:40:31,557 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml' 2026-09-01T00:40:31,559 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:31,560 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml' 2026-09-01T00:40:31,562 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml' 2026-09-01T00:40:31,563 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml' 2026-09-01T00:40:31,565 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml' 2026-09-01T00:40:31,566 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml' 2026-09-01T00:40:31,567 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml' 2026-09-01T00:40:31,569 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:31,570 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml' 2026-09-01T00:40:31,572 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml' 2026-09-01T00:40:31,573 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml' 2026-09-01T00:40:31,575 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml' 2026-09-01T00:40:31,577 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml' 2026-09-01T00:40:31,578 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml' 2026-09-01T00:40:31,580 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml' 2026-09-01T00:40:31,581 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml' 2026-09-01T00:40:31,583 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml' 2026-09-01T00:40:31,585 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml' 2026-09-01T00:40:31,586 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:31,588 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml' 2026-09-01T00:40:31,589 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml' 2026-09-01T00:40:31,592 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml' 2026-09-01T00:40:31,594 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml' 2026-09-01T00:40:31,595 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,596 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml' 2026-09-01T00:40:31,597 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml' 2026-09-01T00:40:31,598 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,599 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,600 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml' 2026-09-01T00:40:31,601 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,602 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,603 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,605 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,606 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml' 2026-09-01T00:40:31,607 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml' 2026-09-01T00:40:31,608 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:31,609 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml' 2026-09-01T00:40:31,610 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:31,612 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:31,613 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml' 2026-09-01T00:40:31,614 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml' 2026-09-01T00:40:31,615 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml' 2026-09-01T00:40:31,616 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:31,618 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:31,619 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:31,620 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml' 2026-09-01T00:40:31,621 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:31,622 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:31,623 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:31,625 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:31,626 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml' 2026-09-01T00:40:31,627 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:31,628 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:31,629 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:31,631 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:31,632 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml' 2026-09-01T00:40:31,633 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml' 2026-09-01T00:40:31,634 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml' 2026-09-01T00:40:31,635 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml' 2026-09-01T00:40:31,637 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:31,638 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml' 2026-09-01T00:40:31,639 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml' 2026-09-01T00:40:31,640 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml' 2026-09-01T00:40:31,641 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml' 2026-09-01T00:40:31,642 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml' 2026-09-01T00:40:31,643 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml' 2026-09-01T00:40:31,645 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:31,646 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml' 2026-09-01T00:40:31,647 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml' 2026-09-01T00:40:31,648 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml' 2026-09-01T00:40:31,649 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml' 2026-09-01T00:40:31,651 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml' 2026-09-01T00:40:31,652 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml' 2026-09-01T00:40:31,653 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml' 2026-09-01T00:40:31,654 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml' 2026-09-01T00:40:31,656 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml' 2026-09-01T00:40:31,657 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml' 2026-09-01T00:40:31,658 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:31,659 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml' 2026-09-01T00:40:31,660 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml' 2026-09-01T00:40:31,661 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py' 2026-09-01T00:40:31,664 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml' 2026-09-01T00:40:31,666 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml' 2026-09-01T00:40:31,667 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,668 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml' 2026-09-01T00:40:31,669 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml' 2026-09-01T00:40:31,670 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,672 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,673 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml' 2026-09-01T00:40:31,674 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,675 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,677 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,678 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,679 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml' 2026-09-01T00:40:31,680 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml' 2026-09-01T00:40:31,682 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:31,683 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml' 2026-09-01T00:40:31,684 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:31,685 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:31,687 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml' 2026-09-01T00:40:31,688 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml' 2026-09-01T00:40:31,689 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml' 2026-09-01T00:40:31,691 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:31,692 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:31,693 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:31,694 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml' 2026-09-01T00:40:31,696 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:31,697 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:31,698 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:31,699 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:31,700 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml' 2026-09-01T00:40:31,701 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:31,703 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:31,704 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:31,705 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:31,706 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml' 2026-09-01T00:40:31,707 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml' 2026-09-01T00:40:31,709 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml' 2026-09-01T00:40:31,710 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml' 2026-09-01T00:40:31,711 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:31,712 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml' 2026-09-01T00:40:31,713 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml' 2026-09-01T00:40:31,715 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml' 2026-09-01T00:40:31,716 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml' 2026-09-01T00:40:31,717 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml' 2026-09-01T00:40:31,718 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml' 2026-09-01T00:40:31,719 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:31,721 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml' 2026-09-01T00:40:31,722 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml' 2026-09-01T00:40:31,723 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml' 2026-09-01T00:40:31,724 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml' 2026-09-01T00:40:31,726 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml' 2026-09-01T00:40:31,727 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml' 2026-09-01T00:40:31,728 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml' 2026-09-01T00:40:31,729 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml' 2026-09-01T00:40:31,730 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml' 2026-09-01T00:40:31,732 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml' 2026-09-01T00:40:31,733 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:31,734 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml' 2026-09-01T00:40:31,735 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml' 2026-09-01T00:40:31,737 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py' 2026-09-01T00:40:31,739 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml' 2026-09-01T00:40:31,741 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml' 2026-09-01T00:40:31,742 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,743 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml' 2026-09-01T00:40:31,744 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml' 2026-09-01T00:40:31,745 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,746 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,748 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml' 2026-09-01T00:40:31,749 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,750 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,751 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,752 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,753 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml' 2026-09-01T00:40:31,755 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml' 2026-09-01T00:40:31,756 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:31,757 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml' 2026-09-01T00:40:31,758 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:31,759 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:31,761 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml' 2026-09-01T00:40:31,762 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml' 2026-09-01T00:40:31,763 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml' 2026-09-01T00:40:31,764 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:31,765 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:31,766 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:31,768 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml' 2026-09-01T00:40:31,769 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:31,770 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:31,771 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:31,772 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:31,774 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml' 2026-09-01T00:40:31,775 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:31,776 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:31,777 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:31,779 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:31,780 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml' 2026-09-01T00:40:31,781 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml' 2026-09-01T00:40:31,782 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml' 2026-09-01T00:40:31,783 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml' 2026-09-01T00:40:31,784 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:31,786 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml' 2026-09-01T00:40:31,787 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml' 2026-09-01T00:40:31,788 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml' 2026-09-01T00:40:31,789 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml' 2026-09-01T00:40:31,790 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml' 2026-09-01T00:40:31,791 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml' 2026-09-01T00:40:31,792 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:31,794 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml' 2026-09-01T00:40:31,795 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml' 2026-09-01T00:40:31,796 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml' 2026-09-01T00:40:31,797 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml' 2026-09-01T00:40:31,798 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml' 2026-09-01T00:40:31,800 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml' 2026-09-01T00:40:31,801 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml' 2026-09-01T00:40:31,802 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml' 2026-09-01T00:40:31,803 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml' 2026-09-01T00:40:31,804 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml' 2026-09-01T00:40:31,806 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:31,807 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml' 2026-09-01T00:40:31,808 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml' 2026-09-01T00:40:31,811 adding 'lm_eval/tasks/mmlu/generative/_default_template_yaml' 2026-09-01T00:40:31,812 adding 'lm_eval/tasks/mmlu/generative/_mmlu.yaml' 2026-09-01T00:40:31,813 adding 'lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,814 adding 'lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml' 2026-09-01T00:40:31,816 adding 'lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml' 2026-09-01T00:40:31,817 adding 'lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,818 adding 'lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,819 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml' 2026-09-01T00:40:31,820 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,821 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,823 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,824 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,825 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml' 2026-09-01T00:40:31,826 adding 'lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml' 2026-09-01T00:40:31,827 adding 'lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:31,829 adding 'lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml' 2026-09-01T00:40:31,830 adding 'lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:31,831 adding 'lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:31,832 adding 'lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml' 2026-09-01T00:40:31,834 adding 'lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml' 2026-09-01T00:40:31,835 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml' 2026-09-01T00:40:31,836 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:31,837 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:31,838 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:31,839 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml' 2026-09-01T00:40:31,840 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:31,841 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:31,843 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:31,844 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:31,845 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml' 2026-09-01T00:40:31,846 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:31,848 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:31,849 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:31,850 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:31,851 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml' 2026-09-01T00:40:31,853 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml' 2026-09-01T00:40:31,854 adding 'lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml' 2026-09-01T00:40:31,855 adding 'lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml' 2026-09-01T00:40:31,856 adding 'lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:31,857 adding 'lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml' 2026-09-01T00:40:31,858 adding 'lm_eval/tasks/mmlu/generative/mmlu_management.yaml' 2026-09-01T00:40:31,860 adding 'lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml' 2026-09-01T00:40:31,861 adding 'lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml' 2026-09-01T00:40:31,862 adding 'lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml' 2026-09-01T00:40:31,863 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml' 2026-09-01T00:40:31,864 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:31,866 adding 'lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml' 2026-09-01T00:40:31,867 adding 'lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml' 2026-09-01T00:40:31,868 adding 'lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml' 2026-09-01T00:40:31,869 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml' 2026-09-01T00:40:31,870 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml' 2026-09-01T00:40:31,872 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml' 2026-09-01T00:40:31,873 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml' 2026-09-01T00:40:31,874 adding 'lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml' 2026-09-01T00:40:31,875 adding 'lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml' 2026-09-01T00:40:31,877 adding 'lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml' 2026-09-01T00:40:31,878 adding 'lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:31,879 adding 'lm_eval/tasks/mmlu/generative/mmlu_virology.yaml' 2026-09-01T00:40:31,880 adding 'lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml' 2026-09-01T00:40:31,882 adding 'lm_eval/tasks/mmlu-pro-plus/README.md' 2026-09-01T00:40:31,884 adding 'lm_eval/tasks/mmlu-pro-plus/_default_template_yaml' 2026-09-01T00:40:31,885 adding 'lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml' 2026-09-01T00:40:31,886 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml' 2026-09-01T00:40:31,888 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml' 2026-09-01T00:40:31,889 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml' 2026-09-01T00:40:31,890 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml' 2026-09-01T00:40:31,891 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml' 2026-09-01T00:40:31,892 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml' 2026-09-01T00:40:31,894 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml' 2026-09-01T00:40:31,895 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml' 2026-09-01T00:40:31,896 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml' 2026-09-01T00:40:31,897 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml' 2026-09-01T00:40:31,898 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml' 2026-09-01T00:40:31,899 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml' 2026-09-01T00:40:31,901 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml' 2026-09-01T00:40:31,902 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml' 2026-09-01T00:40:31,903 adding 'lm_eval/tasks/mmlu-pro-plus/utils.py' 2026-09-01T00:40:31,907 adding 'lm_eval/tasks/mmlu-redux/generative/README.md' 2026-09-01T00:40:31,908 adding 'lm_eval/tasks/mmlu-redux/generative/_default_template_yaml' 2026-09-01T00:40:31,909 adding 'lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml' 2026-09-01T00:40:31,910 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,912 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml' 2026-09-01T00:40:31,913 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml' 2026-09-01T00:40:31,914 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,915 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,917 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml' 2026-09-01T00:40:31,918 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,919 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,920 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,921 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,923 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml' 2026-09-01T00:40:31,924 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml' 2026-09-01T00:40:31,925 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:31,926 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml' 2026-09-01T00:40:31,928 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:31,929 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:31,930 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml' 2026-09-01T00:40:31,931 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml' 2026-09-01T00:40:31,932 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml' 2026-09-01T00:40:31,934 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:31,935 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:31,936 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:31,937 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml' 2026-09-01T00:40:31,938 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:31,940 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:31,941 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:31,942 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:31,943 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml' 2026-09-01T00:40:31,945 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:31,946 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:31,947 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:31,948 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:31,949 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml' 2026-09-01T00:40:31,950 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml' 2026-09-01T00:40:31,951 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml' 2026-09-01T00:40:31,953 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml' 2026-09-01T00:40:31,954 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:31,955 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml' 2026-09-01T00:40:31,956 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml' 2026-09-01T00:40:31,957 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml' 2026-09-01T00:40:31,958 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml' 2026-09-01T00:40:31,959 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml' 2026-09-01T00:40:31,961 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml' 2026-09-01T00:40:31,962 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:31,963 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml' 2026-09-01T00:40:31,964 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml' 2026-09-01T00:40:31,965 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml' 2026-09-01T00:40:31,967 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml' 2026-09-01T00:40:31,968 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml' 2026-09-01T00:40:31,969 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml' 2026-09-01T00:40:31,970 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml' 2026-09-01T00:40:31,971 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml' 2026-09-01T00:40:31,973 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml' 2026-09-01T00:40:31,974 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml' 2026-09-01T00:40:31,975 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:31,976 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml' 2026-09-01T00:40:31,978 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml' 2026-09-01T00:40:31,980 adding 'lm_eval/tasks/mmlu-redux-spanish/README.md' 2026-09-01T00:40:31,981 adding 'lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml' 2026-09-01T00:40:31,984 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml' 2026-09-01T00:40:31,985 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml' 2026-09-01T00:40:31,986 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml' 2026-09-01T00:40:31,987 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml' 2026-09-01T00:40:31,988 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml' 2026-09-01T00:40:31,990 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml' 2026-09-01T00:40:31,991 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml' 2026-09-01T00:40:31,992 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml' 2026-09-01T00:40:31,993 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml' 2026-09-01T00:40:31,995 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml' 2026-09-01T00:40:31,996 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml' 2026-09-01T00:40:31,997 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml' 2026-09-01T00:40:31,999 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml' 2026-09-01T00:40:32,000 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml' 2026-09-01T00:40:32,001 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml' 2026-09-01T00:40:32,002 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml' 2026-09-01T00:40:32,003 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml' 2026-09-01T00:40:32,005 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml' 2026-09-01T00:40:32,006 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml' 2026-09-01T00:40:32,007 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml' 2026-09-01T00:40:32,008 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml' 2026-09-01T00:40:32,009 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml' 2026-09-01T00:40:32,010 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml' 2026-09-01T00:40:32,012 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml' 2026-09-01T00:40:32,013 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml' 2026-09-01T00:40:32,014 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:40:32,015 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:40:32,016 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml' 2026-09-01T00:40:32,017 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:40:32,019 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml' 2026-09-01T00:40:32,020 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml' 2026-09-01T00:40:32,021 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml' 2026-09-01T00:40:32,022 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml' 2026-09-01T00:40:32,023 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml' 2026-09-01T00:40:32,025 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml' 2026-09-01T00:40:32,026 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml' 2026-09-01T00:40:32,027 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml' 2026-09-01T00:40:32,029 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml' 2026-09-01T00:40:32,030 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml' 2026-09-01T00:40:32,031 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml' 2026-09-01T00:40:32,032 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml' 2026-09-01T00:40:32,033 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml' 2026-09-01T00:40:32,034 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml' 2026-09-01T00:40:32,036 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml' 2026-09-01T00:40:32,037 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml' 2026-09-01T00:40:32,038 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml' 2026-09-01T00:40:32,039 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml' 2026-09-01T00:40:32,041 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml' 2026-09-01T00:40:32,042 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml' 2026-09-01T00:40:32,043 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml' 2026-09-01T00:40:32,044 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml' 2026-09-01T00:40:32,045 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml' 2026-09-01T00:40:32,047 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml' 2026-09-01T00:40:32,048 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml' 2026-09-01T00:40:32,049 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml' 2026-09-01T00:40:32,050 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml' 2026-09-01T00:40:32,051 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml' 2026-09-01T00:40:32,052 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml' 2026-09-01T00:40:32,054 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml' 2026-09-01T00:40:32,056 adding 'lm_eval/tasks/mmlu_pro/README.md' 2026-09-01T00:40:32,057 adding 'lm_eval/tasks/mmlu_pro/_default_template_yaml' 2026-09-01T00:40:32,058 adding 'lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml' 2026-09-01T00:40:32,060 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml' 2026-09-01T00:40:32,061 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml' 2026-09-01T00:40:32,062 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml' 2026-09-01T00:40:32,063 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml' 2026-09-01T00:40:32,064 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml' 2026-09-01T00:40:32,066 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml' 2026-09-01T00:40:32,067 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml' 2026-09-01T00:40:32,068 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml' 2026-09-01T00:40:32,069 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml' 2026-09-01T00:40:32,070 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml' 2026-09-01T00:40:32,071 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml' 2026-09-01T00:40:32,073 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml' 2026-09-01T00:40:32,074 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml' 2026-09-01T00:40:32,075 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml' 2026-09-01T00:40:32,076 adding 'lm_eval/tasks/mmlu_pro/utils.py' 2026-09-01T00:40:32,079 adding 'lm_eval/tasks/mmlu_prox/README.md' 2026-09-01T00:40:32,082 adding 'lm_eval/tasks/mmlu_prox/lang_libs.py' 2026-09-01T00:40:32,084 adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py' 2026-09-01T00:40:32,085 adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py' 2026-09-01T00:40:32,087 adding 'lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml' 2026-09-01T00:40:32,089 adding 'lm_eval/tasks/mmlu_prox/af/_af_template_yaml' 2026-09-01T00:40:32,090 adding 'lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml' 2026-09-01T00:40:32,091 adding 'lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml' 2026-09-01T00:40:32,092 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml' 2026-09-01T00:40:32,093 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml' 2026-09-01T00:40:32,095 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml' 2026-09-01T00:40:32,096 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml' 2026-09-01T00:40:32,097 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml' 2026-09-01T00:40:32,098 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml' 2026-09-01T00:40:32,100 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml' 2026-09-01T00:40:32,101 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml' 2026-09-01T00:40:32,102 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml' 2026-09-01T00:40:32,103 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml' 2026-09-01T00:40:32,104 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml' 2026-09-01T00:40:32,106 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml' 2026-09-01T00:40:32,107 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml' 2026-09-01T00:40:32,108 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml' 2026-09-01T00:40:32,109 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml' 2026-09-01T00:40:32,110 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml' 2026-09-01T00:40:32,111 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml' 2026-09-01T00:40:32,112 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml' 2026-09-01T00:40:32,113 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml' 2026-09-01T00:40:32,115 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml' 2026-09-01T00:40:32,116 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml' 2026-09-01T00:40:32,117 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml' 2026-09-01T00:40:32,118 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml' 2026-09-01T00:40:32,119 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml' 2026-09-01T00:40:32,120 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml' 2026-09-01T00:40:32,122 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml' 2026-09-01T00:40:32,123 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml' 2026-09-01T00:40:32,124 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml' 2026-09-01T00:40:32,125 adding 'lm_eval/tasks/mmlu_prox/af/utils.py' 2026-09-01T00:40:32,128 adding 'lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml' 2026-09-01T00:40:32,129 adding 'lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml' 2026-09-01T00:40:32,130 adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml' 2026-09-01T00:40:32,131 adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml' 2026-09-01T00:40:32,133 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml' 2026-09-01T00:40:32,134 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml' 2026-09-01T00:40:32,135 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml' 2026-09-01T00:40:32,137 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml' 2026-09-01T00:40:32,138 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml' 2026-09-01T00:40:32,139 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml' 2026-09-01T00:40:32,140 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml' 2026-09-01T00:40:32,141 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml' 2026-09-01T00:40:32,143 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml' 2026-09-01T00:40:32,144 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml' 2026-09-01T00:40:32,145 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml' 2026-09-01T00:40:32,146 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml' 2026-09-01T00:40:32,147 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml' 2026-09-01T00:40:32,149 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml' 2026-09-01T00:40:32,150 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml' 2026-09-01T00:40:32,151 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml' 2026-09-01T00:40:32,152 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml' 2026-09-01T00:40:32,153 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml' 2026-09-01T00:40:32,155 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml' 2026-09-01T00:40:32,156 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml' 2026-09-01T00:40:32,157 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml' 2026-09-01T00:40:32,158 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml' 2026-09-01T00:40:32,160 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml' 2026-09-01T00:40:32,161 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml' 2026-09-01T00:40:32,162 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml' 2026-09-01T00:40:32,163 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml' 2026-09-01T00:40:32,164 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml' 2026-09-01T00:40:32,165 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml' 2026-09-01T00:40:32,167 adding 'lm_eval/tasks/mmlu_prox/ar/utils.py' 2026-09-01T00:40:32,169 adding 'lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml' 2026-09-01T00:40:32,170 adding 'lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml' 2026-09-01T00:40:32,171 adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml' 2026-09-01T00:40:32,172 adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml' 2026-09-01T00:40:32,173 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml' 2026-09-01T00:40:32,175 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml' 2026-09-01T00:40:32,176 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml' 2026-09-01T00:40:32,177 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml' 2026-09-01T00:40:32,179 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml' 2026-09-01T00:40:32,180 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml' 2026-09-01T00:40:32,181 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml' 2026-09-01T00:40:32,182 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml' 2026-09-01T00:40:32,184 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml' 2026-09-01T00:40:32,185 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml' 2026-09-01T00:40:32,186 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml' 2026-09-01T00:40:32,187 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml' 2026-09-01T00:40:32,188 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml' 2026-09-01T00:40:32,190 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml' 2026-09-01T00:40:32,191 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml' 2026-09-01T00:40:32,192 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml' 2026-09-01T00:40:32,193 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml' 2026-09-01T00:40:32,195 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml' 2026-09-01T00:40:32,196 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml' 2026-09-01T00:40:32,197 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml' 2026-09-01T00:40:32,198 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml' 2026-09-01T00:40:32,200 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml' 2026-09-01T00:40:32,201 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml' 2026-09-01T00:40:32,202 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml' 2026-09-01T00:40:32,203 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml' 2026-09-01T00:40:32,205 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml' 2026-09-01T00:40:32,206 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml' 2026-09-01T00:40:32,207 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml' 2026-09-01T00:40:32,208 adding 'lm_eval/tasks/mmlu_prox/bn/utils.py' 2026-09-01T00:40:32,211 adding 'lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml' 2026-09-01T00:40:32,212 adding 'lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml' 2026-09-01T00:40:32,213 adding 'lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml' 2026-09-01T00:40:32,215 adding 'lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml' 2026-09-01T00:40:32,216 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml' 2026-09-01T00:40:32,217 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml' 2026-09-01T00:40:32,219 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml' 2026-09-01T00:40:32,220 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml' 2026-09-01T00:40:32,221 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml' 2026-09-01T00:40:32,222 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml' 2026-09-01T00:40:32,223 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml' 2026-09-01T00:40:32,225 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml' 2026-09-01T00:40:32,226 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml' 2026-09-01T00:40:32,227 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml' 2026-09-01T00:40:32,228 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml' 2026-09-01T00:40:32,229 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml' 2026-09-01T00:40:32,231 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml' 2026-09-01T00:40:32,232 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml' 2026-09-01T00:40:32,233 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml' 2026-09-01T00:40:32,234 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml' 2026-09-01T00:40:32,236 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml' 2026-09-01T00:40:32,237 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml' 2026-09-01T00:40:32,238 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml' 2026-09-01T00:40:32,239 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml' 2026-09-01T00:40:32,241 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml' 2026-09-01T00:40:32,242 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml' 2026-09-01T00:40:32,243 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml' 2026-09-01T00:40:32,244 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml' 2026-09-01T00:40:32,245 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml' 2026-09-01T00:40:32,247 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml' 2026-09-01T00:40:32,248 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml' 2026-09-01T00:40:32,249 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml' 2026-09-01T00:40:32,250 adding 'lm_eval/tasks/mmlu_prox/cs/utils.py' 2026-09-01T00:40:32,253 adding 'lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml' 2026-09-01T00:40:32,254 adding 'lm_eval/tasks/mmlu_prox/de/_de_template_yaml' 2026-09-01T00:40:32,255 adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml' 2026-09-01T00:40:32,257 adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml' 2026-09-01T00:40:32,258 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml' 2026-09-01T00:40:32,259 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml' 2026-09-01T00:40:32,260 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml' 2026-09-01T00:40:32,261 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml' 2026-09-01T00:40:32,263 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml' 2026-09-01T00:40:32,264 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml' 2026-09-01T00:40:32,265 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml' 2026-09-01T00:40:32,266 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml' 2026-09-01T00:40:32,268 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml' 2026-09-01T00:40:32,269 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml' 2026-09-01T00:40:32,270 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml' 2026-09-01T00:40:32,271 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml' 2026-09-01T00:40:32,273 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml' 2026-09-01T00:40:32,274 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml' 2026-09-01T00:40:32,275 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml' 2026-09-01T00:40:32,277 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml' 2026-09-01T00:40:32,278 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml' 2026-09-01T00:40:32,279 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml' 2026-09-01T00:40:32,280 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml' 2026-09-01T00:40:32,281 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml' 2026-09-01T00:40:32,282 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml' 2026-09-01T00:40:32,283 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml' 2026-09-01T00:40:32,285 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml' 2026-09-01T00:40:32,286 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml' 2026-09-01T00:40:32,287 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml' 2026-09-01T00:40:32,288 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml' 2026-09-01T00:40:32,290 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml' 2026-09-01T00:40:32,291 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml' 2026-09-01T00:40:32,292 adding 'lm_eval/tasks/mmlu_prox/de/utils.py' 2026-09-01T00:40:32,295 adding 'lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml' 2026-09-01T00:40:32,296 adding 'lm_eval/tasks/mmlu_prox/en/_en_template_yaml' 2026-09-01T00:40:32,297 adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml' 2026-09-01T00:40:32,298 adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml' 2026-09-01T00:40:32,299 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml' 2026-09-01T00:40:32,301 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml' 2026-09-01T00:40:32,302 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml' 2026-09-01T00:40:32,303 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml' 2026-09-01T00:40:32,304 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml' 2026-09-01T00:40:32,305 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml' 2026-09-01T00:40:32,307 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml' 2026-09-01T00:40:32,308 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml' 2026-09-01T00:40:32,309 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml' 2026-09-01T00:40:32,310 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml' 2026-09-01T00:40:32,311 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml' 2026-09-01T00:40:32,313 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml' 2026-09-01T00:40:32,314 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml' 2026-09-01T00:40:32,315 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml' 2026-09-01T00:40:32,316 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml' 2026-09-01T00:40:32,317 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml' 2026-09-01T00:40:32,319 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml' 2026-09-01T00:40:32,320 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml' 2026-09-01T00:40:32,321 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml' 2026-09-01T00:40:32,322 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml' 2026-09-01T00:40:32,324 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml' 2026-09-01T00:40:32,325 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml' 2026-09-01T00:40:32,326 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml' 2026-09-01T00:40:32,327 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml' 2026-09-01T00:40:32,329 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml' 2026-09-01T00:40:32,330 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml' 2026-09-01T00:40:32,331 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml' 2026-09-01T00:40:32,332 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml' 2026-09-01T00:40:32,334 adding 'lm_eval/tasks/mmlu_prox/en/utils.py' 2026-09-01T00:40:32,336 adding 'lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml' 2026-09-01T00:40:32,337 adding 'lm_eval/tasks/mmlu_prox/es/_es_template_yaml' 2026-09-01T00:40:32,338 adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml' 2026-09-01T00:40:32,339 adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml' 2026-09-01T00:40:32,340 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml' 2026-09-01T00:40:32,342 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml' 2026-09-01T00:40:32,343 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml' 2026-09-01T00:40:32,344 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml' 2026-09-01T00:40:32,345 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml' 2026-09-01T00:40:32,346 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml' 2026-09-01T00:40:32,347 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml' 2026-09-01T00:40:32,349 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml' 2026-09-01T00:40:32,350 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml' 2026-09-01T00:40:32,351 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml' 2026-09-01T00:40:32,352 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml' 2026-09-01T00:40:32,354 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml' 2026-09-01T00:40:32,355 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml' 2026-09-01T00:40:32,356 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml' 2026-09-01T00:40:32,357 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml' 2026-09-01T00:40:32,358 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml' 2026-09-01T00:40:32,360 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml' 2026-09-01T00:40:32,361 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml' 2026-09-01T00:40:32,362 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml' 2026-09-01T00:40:32,363 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml' 2026-09-01T00:40:32,364 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml' 2026-09-01T00:40:32,366 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml' 2026-09-01T00:40:32,367 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml' 2026-09-01T00:40:32,368 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml' 2026-09-01T00:40:32,369 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml' 2026-09-01T00:40:32,370 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml' 2026-09-01T00:40:32,372 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml' 2026-09-01T00:40:32,373 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml' 2026-09-01T00:40:32,374 adding 'lm_eval/tasks/mmlu_prox/es/utils.py' 2026-09-01T00:40:32,377 adding 'lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml' 2026-09-01T00:40:32,378 adding 'lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml' 2026-09-01T00:40:32,379 adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml' 2026-09-01T00:40:32,380 adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml' 2026-09-01T00:40:32,382 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml' 2026-09-01T00:40:32,383 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml' 2026-09-01T00:40:32,384 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml' 2026-09-01T00:40:32,385 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml' 2026-09-01T00:40:32,387 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml' 2026-09-01T00:40:32,388 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml' 2026-09-01T00:40:32,389 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml' 2026-09-01T00:40:32,390 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml' 2026-09-01T00:40:32,391 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml' 2026-09-01T00:40:32,392 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml' 2026-09-01T00:40:32,393 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml' 2026-09-01T00:40:32,394 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml' 2026-09-01T00:40:32,396 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml' 2026-09-01T00:40:32,397 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml' 2026-09-01T00:40:32,398 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml' 2026-09-01T00:40:32,399 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml' 2026-09-01T00:40:32,400 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml' 2026-09-01T00:40:32,401 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml' 2026-09-01T00:40:32,402 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml' 2026-09-01T00:40:32,404 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml' 2026-09-01T00:40:32,405 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml' 2026-09-01T00:40:32,406 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml' 2026-09-01T00:40:32,407 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml' 2026-09-01T00:40:32,408 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml' 2026-09-01T00:40:32,409 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml' 2026-09-01T00:40:32,410 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml' 2026-09-01T00:40:32,412 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml' 2026-09-01T00:40:32,413 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml' 2026-09-01T00:40:32,414 adding 'lm_eval/tasks/mmlu_prox/fr/utils.py' 2026-09-01T00:40:32,416 adding 'lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml' 2026-09-01T00:40:32,418 adding 'lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml' 2026-09-01T00:40:32,419 adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml' 2026-09-01T00:40:32,420 adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml' 2026-09-01T00:40:32,421 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml' 2026-09-01T00:40:32,423 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml' 2026-09-01T00:40:32,424 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml' 2026-09-01T00:40:32,425 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml' 2026-09-01T00:40:32,426 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml' 2026-09-01T00:40:32,428 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml' 2026-09-01T00:40:32,429 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml' 2026-09-01T00:40:32,430 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml' 2026-09-01T00:40:32,431 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml' 2026-09-01T00:40:32,433 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml' 2026-09-01T00:40:32,434 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml' 2026-09-01T00:40:32,435 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml' 2026-09-01T00:40:32,436 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml' 2026-09-01T00:40:32,438 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml' 2026-09-01T00:40:32,439 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml' 2026-09-01T00:40:32,440 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml' 2026-09-01T00:40:32,441 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml' 2026-09-01T00:40:32,442 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml' 2026-09-01T00:40:32,444 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml' 2026-09-01T00:40:32,445 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml' 2026-09-01T00:40:32,446 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml' 2026-09-01T00:40:32,447 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml' 2026-09-01T00:40:32,449 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml' 2026-09-01T00:40:32,450 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml' 2026-09-01T00:40:32,451 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml' 2026-09-01T00:40:32,452 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml' 2026-09-01T00:40:32,453 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml' 2026-09-01T00:40:32,454 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml' 2026-09-01T00:40:32,456 adding 'lm_eval/tasks/mmlu_prox/hi/utils.py' 2026-09-01T00:40:32,458 adding 'lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml' 2026-09-01T00:40:32,459 adding 'lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml' 2026-09-01T00:40:32,460 adding 'lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml' 2026-09-01T00:40:32,462 adding 'lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml' 2026-09-01T00:40:32,463 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml' 2026-09-01T00:40:32,464 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml' 2026-09-01T00:40:32,465 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml' 2026-09-01T00:40:32,466 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml' 2026-09-01T00:40:32,467 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml' 2026-09-01T00:40:32,469 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml' 2026-09-01T00:40:32,470 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml' 2026-09-01T00:40:32,471 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml' 2026-09-01T00:40:32,472 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml' 2026-09-01T00:40:32,473 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml' 2026-09-01T00:40:32,474 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml' 2026-09-01T00:40:32,476 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml' 2026-09-01T00:40:32,477 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml' 2026-09-01T00:40:32,478 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml' 2026-09-01T00:40:32,479 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml' 2026-09-01T00:40:32,481 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml' 2026-09-01T00:40:32,482 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml' 2026-09-01T00:40:32,483 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml' 2026-09-01T00:40:32,484 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml' 2026-09-01T00:40:32,486 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml' 2026-09-01T00:40:32,487 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml' 2026-09-01T00:40:32,488 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml' 2026-09-01T00:40:32,489 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml' 2026-09-01T00:40:32,490 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml' 2026-09-01T00:40:32,492 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml' 2026-09-01T00:40:32,493 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml' 2026-09-01T00:40:32,494 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml' 2026-09-01T00:40:32,495 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml' 2026-09-01T00:40:32,497 adding 'lm_eval/tasks/mmlu_prox/hu/utils.py' 2026-09-01T00:40:32,499 adding 'lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml' 2026-09-01T00:40:32,500 adding 'lm_eval/tasks/mmlu_prox/id/_id_template_yaml' 2026-09-01T00:40:32,502 adding 'lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml' 2026-09-01T00:40:32,503 adding 'lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml' 2026-09-01T00:40:32,504 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml' 2026-09-01T00:40:32,505 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml' 2026-09-01T00:40:32,506 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml' 2026-09-01T00:40:32,508 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml' 2026-09-01T00:40:32,509 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml' 2026-09-01T00:40:32,510 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml' 2026-09-01T00:40:32,511 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml' 2026-09-01T00:40:32,512 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml' 2026-09-01T00:40:32,513 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml' 2026-09-01T00:40:32,514 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml' 2026-09-01T00:40:32,515 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml' 2026-09-01T00:40:32,517 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml' 2026-09-01T00:40:32,518 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml' 2026-09-01T00:40:32,519 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml' 2026-09-01T00:40:32,520 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml' 2026-09-01T00:40:32,521 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml' 2026-09-01T00:40:32,522 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml' 2026-09-01T00:40:32,523 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml' 2026-09-01T00:40:32,525 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml' 2026-09-01T00:40:32,526 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml' 2026-09-01T00:40:32,527 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml' 2026-09-01T00:40:32,529 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml' 2026-09-01T00:40:32,530 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml' 2026-09-01T00:40:32,531 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml' 2026-09-01T00:40:32,532 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml' 2026-09-01T00:40:32,533 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml' 2026-09-01T00:40:32,535 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml' 2026-09-01T00:40:32,536 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml' 2026-09-01T00:40:32,537 adding 'lm_eval/tasks/mmlu_prox/id/utils.py' 2026-09-01T00:40:32,539 adding 'lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml' 2026-09-01T00:40:32,541 adding 'lm_eval/tasks/mmlu_prox/it/_it_template_yaml' 2026-09-01T00:40:32,542 adding 'lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml' 2026-09-01T00:40:32,543 adding 'lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml' 2026-09-01T00:40:32,544 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml' 2026-09-01T00:40:32,545 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml' 2026-09-01T00:40:32,547 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml' 2026-09-01T00:40:32,548 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml' 2026-09-01T00:40:32,549 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml' 2026-09-01T00:40:32,550 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml' 2026-09-01T00:40:32,551 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml' 2026-09-01T00:40:32,553 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml' 2026-09-01T00:40:32,554 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml' 2026-09-01T00:40:32,555 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml' 2026-09-01T00:40:32,556 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml' 2026-09-01T00:40:32,558 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml' 2026-09-01T00:40:32,559 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml' 2026-09-01T00:40:32,560 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml' 2026-09-01T00:40:32,561 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml' 2026-09-01T00:40:32,562 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml' 2026-09-01T00:40:32,563 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml' 2026-09-01T00:40:32,564 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml' 2026-09-01T00:40:32,566 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml' 2026-09-01T00:40:32,567 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml' 2026-09-01T00:40:32,568 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml' 2026-09-01T00:40:32,569 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml' 2026-09-01T00:40:32,570 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml' 2026-09-01T00:40:32,571 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml' 2026-09-01T00:40:32,572 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml' 2026-09-01T00:40:32,574 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml' 2026-09-01T00:40:32,575 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml' 2026-09-01T00:40:32,576 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml' 2026-09-01T00:40:32,577 adding 'lm_eval/tasks/mmlu_prox/it/utils.py' 2026-09-01T00:40:32,580 adding 'lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml' 2026-09-01T00:40:32,581 adding 'lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml' 2026-09-01T00:40:32,582 adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml' 2026-09-01T00:40:32,583 adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml' 2026-09-01T00:40:32,584 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml' 2026-09-01T00:40:32,586 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml' 2026-09-01T00:40:32,587 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml' 2026-09-01T00:40:32,588 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml' 2026-09-01T00:40:32,589 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml' 2026-09-01T00:40:32,590 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml' 2026-09-01T00:40:32,592 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml' 2026-09-01T00:40:32,593 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml' 2026-09-01T00:40:32,594 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml' 2026-09-01T00:40:32,595 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml' 2026-09-01T00:40:32,597 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml' 2026-09-01T00:40:32,598 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml' 2026-09-01T00:40:32,599 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml' 2026-09-01T00:40:32,600 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml' 2026-09-01T00:40:32,601 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml' 2026-09-01T00:40:32,603 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml' 2026-09-01T00:40:32,604 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml' 2026-09-01T00:40:32,605 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml' 2026-09-01T00:40:32,606 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml' 2026-09-01T00:40:32,608 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml' 2026-09-01T00:40:32,609 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml' 2026-09-01T00:40:32,610 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml' 2026-09-01T00:40:32,611 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml' 2026-09-01T00:40:32,612 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml' 2026-09-01T00:40:32,614 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml' 2026-09-01T00:40:32,615 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml' 2026-09-01T00:40:32,616 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml' 2026-09-01T00:40:32,617 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml' 2026-09-01T00:40:32,618 adding 'lm_eval/tasks/mmlu_prox/ja/utils.py' 2026-09-01T00:40:32,620 adding 'lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml' 2026-09-01T00:40:32,622 adding 'lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml' 2026-09-01T00:40:32,623 adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml' 2026-09-01T00:40:32,624 adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml' 2026-09-01T00:40:32,625 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml' 2026-09-01T00:40:32,626 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml' 2026-09-01T00:40:32,627 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml' 2026-09-01T00:40:32,629 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml' 2026-09-01T00:40:32,630 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml' 2026-09-01T00:40:32,631 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml' 2026-09-01T00:40:32,632 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml' 2026-09-01T00:40:32,633 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml' 2026-09-01T00:40:32,634 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml' 2026-09-01T00:40:32,636 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml' 2026-09-01T00:40:32,637 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml' 2026-09-01T00:40:32,638 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml' 2026-09-01T00:40:32,639 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml' 2026-09-01T00:40:32,640 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml' 2026-09-01T00:40:32,641 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml' 2026-09-01T00:40:32,643 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml' 2026-09-01T00:40:32,644 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml' 2026-09-01T00:40:32,645 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml' 2026-09-01T00:40:32,646 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml' 2026-09-01T00:40:32,648 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml' 2026-09-01T00:40:32,649 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml' 2026-09-01T00:40:32,650 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml' 2026-09-01T00:40:32,651 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml' 2026-09-01T00:40:32,652 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml' 2026-09-01T00:40:32,654 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml' 2026-09-01T00:40:32,655 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml' 2026-09-01T00:40:32,656 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml' 2026-09-01T00:40:32,657 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml' 2026-09-01T00:40:32,659 adding 'lm_eval/tasks/mmlu_prox/ko/utils.py' 2026-09-01T00:40:32,661 adding 'lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml' 2026-09-01T00:40:32,662 adding 'lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml' 2026-09-01T00:40:32,663 adding 'lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml' 2026-09-01T00:40:32,665 adding 'lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml' 2026-09-01T00:40:32,666 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml' 2026-09-01T00:40:32,667 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml' 2026-09-01T00:40:32,668 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml' 2026-09-01T00:40:32,670 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml' 2026-09-01T00:40:32,671 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml' 2026-09-01T00:40:32,672 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml' 2026-09-01T00:40:32,673 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml' 2026-09-01T00:40:32,674 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml' 2026-09-01T00:40:32,676 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml' 2026-09-01T00:40:32,677 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml' 2026-09-01T00:40:32,678 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml' 2026-09-01T00:40:32,679 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml' 2026-09-01T00:40:32,680 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml' 2026-09-01T00:40:32,681 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml' 2026-09-01T00:40:32,683 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml' 2026-09-01T00:40:32,684 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml' 2026-09-01T00:40:32,685 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml' 2026-09-01T00:40:32,686 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml' 2026-09-01T00:40:32,687 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml' 2026-09-01T00:40:32,689 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml' 2026-09-01T00:40:32,690 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml' 2026-09-01T00:40:32,691 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml' 2026-09-01T00:40:32,692 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml' 2026-09-01T00:40:32,693 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml' 2026-09-01T00:40:32,694 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml' 2026-09-01T00:40:32,696 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml' 2026-09-01T00:40:32,697 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml' 2026-09-01T00:40:32,698 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml' 2026-09-01T00:40:32,699 adding 'lm_eval/tasks/mmlu_prox/mr/utils.py' 2026-09-01T00:40:32,702 adding 'lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml' 2026-09-01T00:40:32,703 adding 'lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml' 2026-09-01T00:40:32,704 adding 'lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml' 2026-09-01T00:40:32,706 adding 'lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml' 2026-09-01T00:40:32,707 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml' 2026-09-01T00:40:32,708 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml' 2026-09-01T00:40:32,710 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml' 2026-09-01T00:40:32,711 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml' 2026-09-01T00:40:32,712 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml' 2026-09-01T00:40:32,713 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml' 2026-09-01T00:40:32,714 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml' 2026-09-01T00:40:32,716 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml' 2026-09-01T00:40:32,717 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml' 2026-09-01T00:40:32,718 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml' 2026-09-01T00:40:32,719 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml' 2026-09-01T00:40:32,721 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml' 2026-09-01T00:40:32,722 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml' 2026-09-01T00:40:32,723 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml' 2026-09-01T00:40:32,724 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml' 2026-09-01T00:40:32,726 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml' 2026-09-01T00:40:32,727 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml' 2026-09-01T00:40:32,728 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml' 2026-09-01T00:40:32,729 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml' 2026-09-01T00:40:32,730 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml' 2026-09-01T00:40:32,732 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml' 2026-09-01T00:40:32,733 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml' 2026-09-01T00:40:32,734 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml' 2026-09-01T00:40:32,735 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml' 2026-09-01T00:40:32,736 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml' 2026-09-01T00:40:32,737 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml' 2026-09-01T00:40:32,739 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml' 2026-09-01T00:40:32,740 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml' 2026-09-01T00:40:32,741 adding 'lm_eval/tasks/mmlu_prox/ne/utils.py' 2026-09-01T00:40:32,743 adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml' 2026-09-01T00:40:32,745 adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml' 2026-09-01T00:40:32,746 adding 'lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml' 2026-09-01T00:40:32,747 adding 'lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml' 2026-09-01T00:40:32,748 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml' 2026-09-01T00:40:32,749 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml' 2026-09-01T00:40:32,750 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml' 2026-09-01T00:40:32,752 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml' 2026-09-01T00:40:32,753 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml' 2026-09-01T00:40:32,754 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml' 2026-09-01T00:40:32,755 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml' 2026-09-01T00:40:32,756 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml' 2026-09-01T00:40:32,758 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml' 2026-09-01T00:40:32,759 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml' 2026-09-01T00:40:32,760 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml' 2026-09-01T00:40:32,761 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml' 2026-09-01T00:40:32,762 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml' 2026-09-01T00:40:32,764 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml' 2026-09-01T00:40:32,765 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml' 2026-09-01T00:40:32,766 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml' 2026-09-01T00:40:32,767 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml' 2026-09-01T00:40:32,768 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml' 2026-09-01T00:40:32,770 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml' 2026-09-01T00:40:32,771 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml' 2026-09-01T00:40:32,772 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml' 2026-09-01T00:40:32,773 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml' 2026-09-01T00:40:32,774 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml' 2026-09-01T00:40:32,776 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml' 2026-09-01T00:40:32,777 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml' 2026-09-01T00:40:32,778 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml' 2026-09-01T00:40:32,779 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml' 2026-09-01T00:40:32,781 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml' 2026-09-01T00:40:32,782 adding 'lm_eval/tasks/mmlu_prox/pt/utils.py' 2026-09-01T00:40:32,784 adding 'lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml' 2026-09-01T00:40:32,785 adding 'lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml' 2026-09-01T00:40:32,787 adding 'lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml' 2026-09-01T00:40:32,788 adding 'lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml' 2026-09-01T00:40:32,789 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml' 2026-09-01T00:40:32,790 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml' 2026-09-01T00:40:32,791 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml' 2026-09-01T00:40:32,792 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml' 2026-09-01T00:40:32,794 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml' 2026-09-01T00:40:32,795 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml' 2026-09-01T00:40:32,796 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml' 2026-09-01T00:40:32,797 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml' 2026-09-01T00:40:32,798 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml' 2026-09-01T00:40:32,800 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml' 2026-09-01T00:40:32,801 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml' 2026-09-01T00:40:32,802 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml' 2026-09-01T00:40:32,803 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml' 2026-09-01T00:40:32,804 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml' 2026-09-01T00:40:32,806 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml' 2026-09-01T00:40:32,807 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml' 2026-09-01T00:40:32,808 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml' 2026-09-01T00:40:32,809 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml' 2026-09-01T00:40:32,811 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml' 2026-09-01T00:40:32,812 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml' 2026-09-01T00:40:32,814 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml' 2026-09-01T00:40:32,815 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml' 2026-09-01T00:40:32,816 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml' 2026-09-01T00:40:32,817 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml' 2026-09-01T00:40:32,818 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml' 2026-09-01T00:40:32,820 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml' 2026-09-01T00:40:32,821 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml' 2026-09-01T00:40:32,822 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml' 2026-09-01T00:40:32,824 adding 'lm_eval/tasks/mmlu_prox/ru/utils.py' 2026-09-01T00:40:32,826 adding 'lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml' 2026-09-01T00:40:32,828 adding 'lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml' 2026-09-01T00:40:32,829 adding 'lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml' 2026-09-01T00:40:32,830 adding 'lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml' 2026-09-01T00:40:32,831 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml' 2026-09-01T00:40:32,833 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml' 2026-09-01T00:40:32,834 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml' 2026-09-01T00:40:32,835 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml' 2026-09-01T00:40:32,836 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml' 2026-09-01T00:40:32,838 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml' 2026-09-01T00:40:32,839 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml' 2026-09-01T00:40:32,840 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml' 2026-09-01T00:40:32,841 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml' 2026-09-01T00:40:32,842 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml' 2026-09-01T00:40:32,844 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml' 2026-09-01T00:40:32,845 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml' 2026-09-01T00:40:32,846 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml' 2026-09-01T00:40:32,847 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml' 2026-09-01T00:40:32,848 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml' 2026-09-01T00:40:32,849 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml' 2026-09-01T00:40:32,850 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml' 2026-09-01T00:40:32,852 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml' 2026-09-01T00:40:32,853 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml' 2026-09-01T00:40:32,854 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml' 2026-09-01T00:40:32,855 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml' 2026-09-01T00:40:32,857 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml' 2026-09-01T00:40:32,858 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml' 2026-09-01T00:40:32,859 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml' 2026-09-01T00:40:32,860 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml' 2026-09-01T00:40:32,861 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml' 2026-09-01T00:40:32,862 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml' 2026-09-01T00:40:32,863 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml' 2026-09-01T00:40:32,865 adding 'lm_eval/tasks/mmlu_prox/sr/utils.py' 2026-09-01T00:40:32,867 adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml' 2026-09-01T00:40:32,868 adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml' 2026-09-01T00:40:32,870 adding 'lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml' 2026-09-01T00:40:32,871 adding 'lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml' 2026-09-01T00:40:32,872 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml' 2026-09-01T00:40:32,873 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml' 2026-09-01T00:40:32,875 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml' 2026-09-01T00:40:32,876 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml' 2026-09-01T00:40:32,877 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml' 2026-09-01T00:40:32,878 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml' 2026-09-01T00:40:32,880 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml' 2026-09-01T00:40:32,881 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml' 2026-09-01T00:40:32,882 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml' 2026-09-01T00:40:32,884 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml' 2026-09-01T00:40:32,885 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml' 2026-09-01T00:40:32,886 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml' 2026-09-01T00:40:32,887 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml' 2026-09-01T00:40:32,889 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml' 2026-09-01T00:40:32,890 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml' 2026-09-01T00:40:32,891 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml' 2026-09-01T00:40:32,893 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml' 2026-09-01T00:40:32,894 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml' 2026-09-01T00:40:32,895 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml' 2026-09-01T00:40:32,897 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml' 2026-09-01T00:40:32,898 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml' 2026-09-01T00:40:32,899 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml' 2026-09-01T00:40:32,901 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml' 2026-09-01T00:40:32,902 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml' 2026-09-01T00:40:32,903 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml' 2026-09-01T00:40:32,904 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml' 2026-09-01T00:40:32,905 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml' 2026-09-01T00:40:32,906 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml' 2026-09-01T00:40:32,907 adding 'lm_eval/tasks/mmlu_prox/sw/utils.py' 2026-09-01T00:40:32,910 adding 'lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml' 2026-09-01T00:40:32,911 adding 'lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml' 2026-09-01T00:40:32,912 adding 'lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml' 2026-09-01T00:40:32,913 adding 'lm_eval/tasks/mmlu_prox/te/_te_template_yaml' 2026-09-01T00:40:32,915 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml' 2026-09-01T00:40:32,916 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml' 2026-09-01T00:40:32,917 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml' 2026-09-01T00:40:32,919 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml' 2026-09-01T00:40:32,920 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml' 2026-09-01T00:40:32,921 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml' 2026-09-01T00:40:32,922 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml' 2026-09-01T00:40:32,923 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml' 2026-09-01T00:40:32,925 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml' 2026-09-01T00:40:32,926 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml' 2026-09-01T00:40:32,927 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml' 2026-09-01T00:40:32,928 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml' 2026-09-01T00:40:32,930 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml' 2026-09-01T00:40:32,931 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml' 2026-09-01T00:40:32,932 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml' 2026-09-01T00:40:32,933 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml' 2026-09-01T00:40:32,935 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml' 2026-09-01T00:40:32,936 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml' 2026-09-01T00:40:32,937 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml' 2026-09-01T00:40:32,938 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml' 2026-09-01T00:40:32,940 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml' 2026-09-01T00:40:32,941 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml' 2026-09-01T00:40:32,942 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml' 2026-09-01T00:40:32,943 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml' 2026-09-01T00:40:32,945 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml' 2026-09-01T00:40:32,946 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml' 2026-09-01T00:40:32,947 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml' 2026-09-01T00:40:32,948 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml' 2026-09-01T00:40:32,950 adding 'lm_eval/tasks/mmlu_prox/te/utils.py' 2026-09-01T00:40:32,952 adding 'lm_eval/tasks/mmlu_prox/template/_lang_template_yaml' 2026-09-01T00:40:32,953 adding 'lm_eval/tasks/mmlu_prox/template/utils.py' 2026-09-01T00:40:32,956 adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml' 2026-09-01T00:40:32,957 adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml' 2026-09-01T00:40:32,958 adding 'lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml' 2026-09-01T00:40:32,959 adding 'lm_eval/tasks/mmlu_prox/th/_th_template_yaml' 2026-09-01T00:40:32,961 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml' 2026-09-01T00:40:32,962 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml' 2026-09-01T00:40:32,963 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml' 2026-09-01T00:40:32,964 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml' 2026-09-01T00:40:32,966 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml' 2026-09-01T00:40:32,967 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml' 2026-09-01T00:40:32,968 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml' 2026-09-01T00:40:32,969 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml' 2026-09-01T00:40:32,970 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml' 2026-09-01T00:40:32,971 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml' 2026-09-01T00:40:32,973 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml' 2026-09-01T00:40:32,974 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml' 2026-09-01T00:40:32,975 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml' 2026-09-01T00:40:32,976 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml' 2026-09-01T00:40:32,978 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml' 2026-09-01T00:40:32,979 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml' 2026-09-01T00:40:32,980 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml' 2026-09-01T00:40:32,981 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml' 2026-09-01T00:40:32,982 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml' 2026-09-01T00:40:32,984 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml' 2026-09-01T00:40:32,985 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml' 2026-09-01T00:40:32,986 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml' 2026-09-01T00:40:32,988 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml' 2026-09-01T00:40:32,989 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml' 2026-09-01T00:40:32,990 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml' 2026-09-01T00:40:32,991 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml' 2026-09-01T00:40:32,993 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml' 2026-09-01T00:40:32,994 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml' 2026-09-01T00:40:32,995 adding 'lm_eval/tasks/mmlu_prox/th/utils.py' 2026-09-01T00:40:32,998 adding 'lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml' 2026-09-01T00:40:32,999 adding 'lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml' 2026-09-01T00:40:33,000 adding 'lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml' 2026-09-01T00:40:33,002 adding 'lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml' 2026-09-01T00:40:33,003 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml' 2026-09-01T00:40:33,004 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml' 2026-09-01T00:40:33,006 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml' 2026-09-01T00:40:33,007 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml' 2026-09-01T00:40:33,008 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml' 2026-09-01T00:40:33,009 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml' 2026-09-01T00:40:33,011 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml' 2026-09-01T00:40:33,012 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml' 2026-09-01T00:40:33,013 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml' 2026-09-01T00:40:33,015 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml' 2026-09-01T00:40:33,016 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml' 2026-09-01T00:40:33,017 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml' 2026-09-01T00:40:33,018 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml' 2026-09-01T00:40:33,020 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml' 2026-09-01T00:40:33,021 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml' 2026-09-01T00:40:33,022 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml' 2026-09-01T00:40:33,023 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml' 2026-09-01T00:40:33,024 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml' 2026-09-01T00:40:33,026 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml' 2026-09-01T00:40:33,027 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml' 2026-09-01T00:40:33,028 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml' 2026-09-01T00:40:33,029 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml' 2026-09-01T00:40:33,031 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml' 2026-09-01T00:40:33,032 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml' 2026-09-01T00:40:33,033 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml' 2026-09-01T00:40:33,034 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml' 2026-09-01T00:40:33,036 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml' 2026-09-01T00:40:33,037 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml' 2026-09-01T00:40:33,038 adding 'lm_eval/tasks/mmlu_prox/uk/utils.py' 2026-09-01T00:40:33,041 adding 'lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml' 2026-09-01T00:40:33,042 adding 'lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml' 2026-09-01T00:40:33,043 adding 'lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml' 2026-09-01T00:40:33,044 adding 'lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml' 2026-09-01T00:40:33,045 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml' 2026-09-01T00:40:33,047 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml' 2026-09-01T00:40:33,048 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml' 2026-09-01T00:40:33,049 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml' 2026-09-01T00:40:33,050 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml' 2026-09-01T00:40:33,051 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml' 2026-09-01T00:40:33,053 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml' 2026-09-01T00:40:33,054 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml' 2026-09-01T00:40:33,055 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml' 2026-09-01T00:40:33,056 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml' 2026-09-01T00:40:33,058 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml' 2026-09-01T00:40:33,059 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml' 2026-09-01T00:40:33,060 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml' 2026-09-01T00:40:33,061 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml' 2026-09-01T00:40:33,062 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml' 2026-09-01T00:40:33,064 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml' 2026-09-01T00:40:33,065 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml' 2026-09-01T00:40:33,066 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml' 2026-09-01T00:40:33,068 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml' 2026-09-01T00:40:33,069 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml' 2026-09-01T00:40:33,070 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml' 2026-09-01T00:40:33,071 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml' 2026-09-01T00:40:33,072 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml' 2026-09-01T00:40:33,074 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml' 2026-09-01T00:40:33,075 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml' 2026-09-01T00:40:33,076 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml' 2026-09-01T00:40:33,077 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml' 2026-09-01T00:40:33,078 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml' 2026-09-01T00:40:33,080 adding 'lm_eval/tasks/mmlu_prox/ur/utils.py' 2026-09-01T00:40:33,082 adding 'lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml' 2026-09-01T00:40:33,083 adding 'lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml' 2026-09-01T00:40:33,084 adding 'lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml' 2026-09-01T00:40:33,086 adding 'lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml' 2026-09-01T00:40:33,087 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml' 2026-09-01T00:40:33,088 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml' 2026-09-01T00:40:33,089 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml' 2026-09-01T00:40:33,091 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml' 2026-09-01T00:40:33,092 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml' 2026-09-01T00:40:33,093 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml' 2026-09-01T00:40:33,094 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml' 2026-09-01T00:40:33,095 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml' 2026-09-01T00:40:33,097 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml' 2026-09-01T00:40:33,098 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml' 2026-09-01T00:40:33,099 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml' 2026-09-01T00:40:33,100 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml' 2026-09-01T00:40:33,101 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml' 2026-09-01T00:40:33,103 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml' 2026-09-01T00:40:33,104 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml' 2026-09-01T00:40:33,105 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml' 2026-09-01T00:40:33,106 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml' 2026-09-01T00:40:33,108 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml' 2026-09-01T00:40:33,109 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml' 2026-09-01T00:40:33,110 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml' 2026-09-01T00:40:33,111 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml' 2026-09-01T00:40:33,112 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml' 2026-09-01T00:40:33,113 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml' 2026-09-01T00:40:33,115 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml' 2026-09-01T00:40:33,116 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml' 2026-09-01T00:40:33,117 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml' 2026-09-01T00:40:33,118 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml' 2026-09-01T00:40:33,120 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml' 2026-09-01T00:40:33,121 adding 'lm_eval/tasks/mmlu_prox/vi/utils.py' 2026-09-01T00:40:33,123 adding 'lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml' 2026-09-01T00:40:33,125 adding 'lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml' 2026-09-01T00:40:33,126 adding 'lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml' 2026-09-01T00:40:33,127 adding 'lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml' 2026-09-01T00:40:33,128 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml' 2026-09-01T00:40:33,130 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml' 2026-09-01T00:40:33,131 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml' 2026-09-01T00:40:33,132 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml' 2026-09-01T00:40:33,134 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml' 2026-09-01T00:40:33,135 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml' 2026-09-01T00:40:33,136 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml' 2026-09-01T00:40:33,137 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml' 2026-09-01T00:40:33,138 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml' 2026-09-01T00:40:33,139 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml' 2026-09-01T00:40:33,140 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml' 2026-09-01T00:40:33,141 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml' 2026-09-01T00:40:33,143 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml' 2026-09-01T00:40:33,144 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml' 2026-09-01T00:40:33,145 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml' 2026-09-01T00:40:33,146 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml' 2026-09-01T00:40:33,147 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml' 2026-09-01T00:40:33,149 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml' 2026-09-01T00:40:33,150 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml' 2026-09-01T00:40:33,151 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml' 2026-09-01T00:40:33,152 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml' 2026-09-01T00:40:33,153 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml' 2026-09-01T00:40:33,155 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml' 2026-09-01T00:40:33,156 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml' 2026-09-01T00:40:33,157 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml' 2026-09-01T00:40:33,158 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml' 2026-09-01T00:40:33,159 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml' 2026-09-01T00:40:33,160 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml' 2026-09-01T00:40:33,162 adding 'lm_eval/tasks/mmlu_prox/wo/utils.py' 2026-09-01T00:40:33,164 adding 'lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml' 2026-09-01T00:40:33,165 adding 'lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml' 2026-09-01T00:40:33,167 adding 'lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml' 2026-09-01T00:40:33,168 adding 'lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml' 2026-09-01T00:40:33,169 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml' 2026-09-01T00:40:33,170 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml' 2026-09-01T00:40:33,171 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml' 2026-09-01T00:40:33,173 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml' 2026-09-01T00:40:33,174 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml' 2026-09-01T00:40:33,175 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml' 2026-09-01T00:40:33,176 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml' 2026-09-01T00:40:33,178 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml' 2026-09-01T00:40:33,179 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml' 2026-09-01T00:40:33,180 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml' 2026-09-01T00:40:33,181 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml' 2026-09-01T00:40:33,183 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml' 2026-09-01T00:40:33,184 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml' 2026-09-01T00:40:33,185 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml' 2026-09-01T00:40:33,186 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml' 2026-09-01T00:40:33,188 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml' 2026-09-01T00:40:33,189 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml' 2026-09-01T00:40:33,190 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml' 2026-09-01T00:40:33,191 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml' 2026-09-01T00:40:33,192 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml' 2026-09-01T00:40:33,194 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml' 2026-09-01T00:40:33,195 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml' 2026-09-01T00:40:33,196 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml' 2026-09-01T00:40:33,197 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml' 2026-09-01T00:40:33,199 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml' 2026-09-01T00:40:33,200 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml' 2026-09-01T00:40:33,201 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml' 2026-09-01T00:40:33,202 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml' 2026-09-01T00:40:33,204 adding 'lm_eval/tasks/mmlu_prox/yo/utils.py' 2026-09-01T00:40:33,206 adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml' 2026-09-01T00:40:33,207 adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml' 2026-09-01T00:40:33,208 adding 'lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml' 2026-09-01T00:40:33,210 adding 'lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml' 2026-09-01T00:40:33,211 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml' 2026-09-01T00:40:33,212 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml' 2026-09-01T00:40:33,213 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml' 2026-09-01T00:40:33,214 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml' 2026-09-01T00:40:33,216 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml' 2026-09-01T00:40:33,217 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml' 2026-09-01T00:40:33,218 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml' 2026-09-01T00:40:33,219 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml' 2026-09-01T00:40:33,221 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml' 2026-09-01T00:40:33,222 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml' 2026-09-01T00:40:33,223 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml' 2026-09-01T00:40:33,224 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml' 2026-09-01T00:40:33,225 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml' 2026-09-01T00:40:33,227 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml' 2026-09-01T00:40:33,228 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml' 2026-09-01T00:40:33,229 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml' 2026-09-01T00:40:33,230 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml' 2026-09-01T00:40:33,231 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml' 2026-09-01T00:40:33,233 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml' 2026-09-01T00:40:33,234 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml' 2026-09-01T00:40:33,235 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml' 2026-09-01T00:40:33,236 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml' 2026-09-01T00:40:33,238 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml' 2026-09-01T00:40:33,239 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml' 2026-09-01T00:40:33,240 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml' 2026-09-01T00:40:33,242 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml' 2026-09-01T00:40:33,243 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml' 2026-09-01T00:40:33,244 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml' 2026-09-01T00:40:33,246 adding 'lm_eval/tasks/mmlu_prox/zh/utils.py' 2026-09-01T00:40:33,248 adding 'lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml' 2026-09-01T00:40:33,249 adding 'lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml' 2026-09-01T00:40:33,251 adding 'lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml' 2026-09-01T00:40:33,252 adding 'lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml' 2026-09-01T00:40:33,253 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml' 2026-09-01T00:40:33,254 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml' 2026-09-01T00:40:33,255 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml' 2026-09-01T00:40:33,256 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml' 2026-09-01T00:40:33,257 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml' 2026-09-01T00:40:33,259 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml' 2026-09-01T00:40:33,260 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml' 2026-09-01T00:40:33,261 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml' 2026-09-01T00:40:33,262 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml' 2026-09-01T00:40:33,264 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml' 2026-09-01T00:40:33,265 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml' 2026-09-01T00:40:33,266 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml' 2026-09-01T00:40:33,267 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml' 2026-09-01T00:40:33,269 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml' 2026-09-01T00:40:33,270 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml' 2026-09-01T00:40:33,271 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml' 2026-09-01T00:40:33,272 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml' 2026-09-01T00:40:33,274 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml' 2026-09-01T00:40:33,275 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml' 2026-09-01T00:40:33,276 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml' 2026-09-01T00:40:33,277 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml' 2026-09-01T00:40:33,278 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml' 2026-09-01T00:40:33,280 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml' 2026-09-01T00:40:33,281 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml' 2026-09-01T00:40:33,282 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml' 2026-09-01T00:40:33,284 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml' 2026-09-01T00:40:33,285 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml' 2026-09-01T00:40:33,286 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml' 2026-09-01T00:40:33,287 adding 'lm_eval/tasks/mmlu_prox/zu/utils.py' 2026-09-01T00:40:33,290 adding 'lm_eval/tasks/mmlusr/README.md' 2026-09-01T00:40:33,292 adding 'lm_eval/tasks/mmlusr/config.py' 2026-09-01T00:40:33,294 adding 'lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml' 2026-09-01T00:40:33,296 adding 'lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml' 2026-09-01T00:40:33,297 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml' 2026-09-01T00:40:33,298 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml' 2026-09-01T00:40:33,299 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml' 2026-09-01T00:40:33,301 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml' 2026-09-01T00:40:33,303 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml' 2026-09-01T00:40:33,305 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml' 2026-09-01T00:40:33,307 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml' 2026-09-01T00:40:33,308 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml' 2026-09-01T00:40:33,309 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml' 2026-09-01T00:40:33,310 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml' 2026-09-01T00:40:33,311 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml' 2026-09-01T00:40:33,313 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml' 2026-09-01T00:40:33,314 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml' 2026-09-01T00:40:33,315 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml' 2026-09-01T00:40:33,316 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml' 2026-09-01T00:40:33,317 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml' 2026-09-01T00:40:33,318 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml' 2026-09-01T00:40:33,320 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml' 2026-09-01T00:40:33,321 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml' 2026-09-01T00:40:33,322 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml' 2026-09-01T00:40:33,323 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml' 2026-09-01T00:40:33,324 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml' 2026-09-01T00:40:33,326 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml' 2026-09-01T00:40:33,327 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml' 2026-09-01T00:40:33,328 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml' 2026-09-01T00:40:33,329 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml' 2026-09-01T00:40:33,330 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml' 2026-09-01T00:40:33,332 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml' 2026-09-01T00:40:33,333 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml' 2026-09-01T00:40:33,334 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml' 2026-09-01T00:40:33,335 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml' 2026-09-01T00:40:33,337 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml' 2026-09-01T00:40:33,338 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml' 2026-09-01T00:40:33,339 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml' 2026-09-01T00:40:33,340 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml' 2026-09-01T00:40:33,341 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml' 2026-09-01T00:40:33,342 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml' 2026-09-01T00:40:33,344 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml' 2026-09-01T00:40:33,345 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml' 2026-09-01T00:40:33,346 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml' 2026-09-01T00:40:33,347 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml' 2026-09-01T00:40:33,349 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml' 2026-09-01T00:40:33,350 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml' 2026-09-01T00:40:33,351 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml' 2026-09-01T00:40:33,352 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml' 2026-09-01T00:40:33,353 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml' 2026-09-01T00:40:33,355 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml' 2026-09-01T00:40:33,356 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml' 2026-09-01T00:40:33,357 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml' 2026-09-01T00:40:33,358 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml' 2026-09-01T00:40:33,360 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml' 2026-09-01T00:40:33,361 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml' 2026-09-01T00:40:33,362 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml' 2026-09-01T00:40:33,363 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml' 2026-09-01T00:40:33,364 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml' 2026-09-01T00:40:33,365 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml' 2026-09-01T00:40:33,367 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml' 2026-09-01T00:40:33,368 adding 'lm_eval/tasks/mmlusr/answer_only/utils.py' 2026-09-01T00:40:33,371 adding 'lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml' 2026-09-01T00:40:33,372 adding 'lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml' 2026-09-01T00:40:33,373 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml' 2026-09-01T00:40:33,374 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml' 2026-09-01T00:40:33,376 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml' 2026-09-01T00:40:33,377 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml' 2026-09-01T00:40:33,378 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml' 2026-09-01T00:40:33,379 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml' 2026-09-01T00:40:33,380 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml' 2026-09-01T00:40:33,382 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml' 2026-09-01T00:40:33,383 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml' 2026-09-01T00:40:33,384 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml' 2026-09-01T00:40:33,385 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml' 2026-09-01T00:40:33,387 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml' 2026-09-01T00:40:33,388 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml' 2026-09-01T00:40:33,389 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml' 2026-09-01T00:40:33,390 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml' 2026-09-01T00:40:33,391 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml' 2026-09-01T00:40:33,393 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml' 2026-09-01T00:40:33,394 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml' 2026-09-01T00:40:33,395 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml' 2026-09-01T00:40:33,396 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml' 2026-09-01T00:40:33,398 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml' 2026-09-01T00:40:33,399 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml' 2026-09-01T00:40:33,400 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml' 2026-09-01T00:40:33,401 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml' 2026-09-01T00:40:33,403 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml' 2026-09-01T00:40:33,404 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml' 2026-09-01T00:40:33,405 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml' 2026-09-01T00:40:33,406 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml' 2026-09-01T00:40:33,407 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml' 2026-09-01T00:40:33,408 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml' 2026-09-01T00:40:33,409 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml' 2026-09-01T00:40:33,410 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml' 2026-09-01T00:40:33,412 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml' 2026-09-01T00:40:33,413 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml' 2026-09-01T00:40:33,414 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml' 2026-09-01T00:40:33,415 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml' 2026-09-01T00:40:33,417 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml' 2026-09-01T00:40:33,418 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml' 2026-09-01T00:40:33,419 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml' 2026-09-01T00:40:33,420 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml' 2026-09-01T00:40:33,421 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml' 2026-09-01T00:40:33,422 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml' 2026-09-01T00:40:33,424 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml' 2026-09-01T00:40:33,425 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml' 2026-09-01T00:40:33,426 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml' 2026-09-01T00:40:33,427 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml' 2026-09-01T00:40:33,428 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml' 2026-09-01T00:40:33,430 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml' 2026-09-01T00:40:33,431 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml' 2026-09-01T00:40:33,432 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml' 2026-09-01T00:40:33,434 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml' 2026-09-01T00:40:33,435 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml' 2026-09-01T00:40:33,436 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml' 2026-09-01T00:40:33,437 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml' 2026-09-01T00:40:33,439 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml' 2026-09-01T00:40:33,440 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml' 2026-09-01T00:40:33,441 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml' 2026-09-01T00:40:33,442 adding 'lm_eval/tasks/mmlusr/question_and_answer/utils.py' 2026-09-01T00:40:33,445 adding 'lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml' 2026-09-01T00:40:33,446 adding 'lm_eval/tasks/mmlusr/question_only/_question_only.yaml' 2026-09-01T00:40:33,448 adding 'lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml' 2026-09-01T00:40:33,449 adding 'lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml' 2026-09-01T00:40:33,450 adding 'lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml' 2026-09-01T00:40:33,451 adding 'lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml' 2026-09-01T00:40:33,452 adding 'lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml' 2026-09-01T00:40:33,453 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml' 2026-09-01T00:40:33,454 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml' 2026-09-01T00:40:33,456 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml' 2026-09-01T00:40:33,457 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml' 2026-09-01T00:40:33,458 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml' 2026-09-01T00:40:33,459 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml' 2026-09-01T00:40:33,461 adding 'lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml' 2026-09-01T00:40:33,462 adding 'lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml' 2026-09-01T00:40:33,463 adding 'lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml' 2026-09-01T00:40:33,464 adding 'lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml' 2026-09-01T00:40:33,465 adding 'lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml' 2026-09-01T00:40:33,467 adding 'lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml' 2026-09-01T00:40:33,468 adding 'lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml' 2026-09-01T00:40:33,469 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml' 2026-09-01T00:40:33,470 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml' 2026-09-01T00:40:33,471 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml' 2026-09-01T00:40:33,473 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml' 2026-09-01T00:40:33,474 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml' 2026-09-01T00:40:33,475 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml' 2026-09-01T00:40:33,476 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml' 2026-09-01T00:40:33,478 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml' 2026-09-01T00:40:33,479 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml' 2026-09-01T00:40:33,480 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml' 2026-09-01T00:40:33,481 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml' 2026-09-01T00:40:33,483 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml' 2026-09-01T00:40:33,484 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml' 2026-09-01T00:40:33,485 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml' 2026-09-01T00:40:33,486 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml' 2026-09-01T00:40:33,488 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml' 2026-09-01T00:40:33,489 adding 'lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml' 2026-09-01T00:40:33,490 adding 'lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml' 2026-09-01T00:40:33,491 adding 'lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml' 2026-09-01T00:40:33,493 adding 'lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml' 2026-09-01T00:40:33,494 adding 'lm_eval/tasks/mmlusr/question_only/question_only_management.yaml' 2026-09-01T00:40:33,495 adding 'lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml' 2026-09-01T00:40:33,496 adding 'lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml' 2026-09-01T00:40:33,497 adding 'lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml' 2026-09-01T00:40:33,498 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml' 2026-09-01T00:40:33,500 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml' 2026-09-01T00:40:33,501 adding 'lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml' 2026-09-01T00:40:33,502 adding 'lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml' 2026-09-01T00:40:33,503 adding 'lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml' 2026-09-01T00:40:33,505 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml' 2026-09-01T00:40:33,506 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml' 2026-09-01T00:40:33,507 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml' 2026-09-01T00:40:33,508 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml' 2026-09-01T00:40:33,509 adding 'lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml' 2026-09-01T00:40:33,511 adding 'lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml' 2026-09-01T00:40:33,512 adding 'lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml' 2026-09-01T00:40:33,513 adding 'lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml' 2026-09-01T00:40:33,514 adding 'lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml' 2026-09-01T00:40:33,516 adding 'lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml' 2026-09-01T00:40:33,517 adding 'lm_eval/tasks/mmlusr/question_only/utils.py' 2026-09-01T00:40:33,520 adding 'lm_eval/tasks/mmmu/README.md' 2026-09-01T00:40:33,521 adding 'lm_eval/tasks/mmmu/_art_and_design.yaml' 2026-09-01T00:40:33,522 adding 'lm_eval/tasks/mmmu/_business.yaml' 2026-09-01T00:40:33,523 adding 'lm_eval/tasks/mmmu/_health_and_medicine.yaml' 2026-09-01T00:40:33,524 adding 'lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml' 2026-09-01T00:40:33,526 adding 'lm_eval/tasks/mmmu/_mmmu.yaml' 2026-09-01T00:40:33,527 adding 'lm_eval/tasks/mmmu/_science.yaml' 2026-09-01T00:40:33,528 adding 'lm_eval/tasks/mmmu/_tech_and_engineering.yaml' 2026-09-01T00:40:33,529 adding 'lm_eval/tasks/mmmu/_template_yaml' 2026-09-01T00:40:33,530 adding 'lm_eval/tasks/mmmu/mmmu_accounting.yaml' 2026-09-01T00:40:33,531 adding 'lm_eval/tasks/mmmu/mmmu_agriculture.yaml' 2026-09-01T00:40:33,533 adding 'lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml' 2026-09-01T00:40:33,534 adding 'lm_eval/tasks/mmmu/mmmu_art.yaml' 2026-09-01T00:40:33,535 adding 'lm_eval/tasks/mmmu/mmmu_art_theory.yaml' 2026-09-01T00:40:33,536 adding 'lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml' 2026-09-01T00:40:33,537 adding 'lm_eval/tasks/mmmu/mmmu_biology.yaml' 2026-09-01T00:40:33,538 adding 'lm_eval/tasks/mmmu/mmmu_chemistry.yaml' 2026-09-01T00:40:33,540 adding 'lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml' 2026-09-01T00:40:33,541 adding 'lm_eval/tasks/mmmu/mmmu_computer_science.yaml' 2026-09-01T00:40:33,542 adding 'lm_eval/tasks/mmmu/mmmu_design.yaml' 2026-09-01T00:40:33,543 adding 'lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml' 2026-09-01T00:40:33,544 adding 'lm_eval/tasks/mmmu/mmmu_economics.yaml' 2026-09-01T00:40:33,545 adding 'lm_eval/tasks/mmmu/mmmu_electronics.yaml' 2026-09-01T00:40:33,547 adding 'lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml' 2026-09-01T00:40:33,548 adding 'lm_eval/tasks/mmmu/mmmu_finance.yaml' 2026-09-01T00:40:33,549 adding 'lm_eval/tasks/mmmu/mmmu_geography.yaml' 2026-09-01T00:40:33,550 adding 'lm_eval/tasks/mmmu/mmmu_history.yaml' 2026-09-01T00:40:33,551 adding 'lm_eval/tasks/mmmu/mmmu_literature.yaml' 2026-09-01T00:40:33,552 adding 'lm_eval/tasks/mmmu/mmmu_manage.yaml' 2026-09-01T00:40:33,553 adding 'lm_eval/tasks/mmmu/mmmu_marketing.yaml' 2026-09-01T00:40:33,554 adding 'lm_eval/tasks/mmmu/mmmu_materials.yaml' 2026-09-01T00:40:33,556 adding 'lm_eval/tasks/mmmu/mmmu_math.yaml' 2026-09-01T00:40:33,557 adding 'lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml' 2026-09-01T00:40:33,558 adding 'lm_eval/tasks/mmmu/mmmu_music.yaml' 2026-09-01T00:40:33,559 adding 'lm_eval/tasks/mmmu/mmmu_pharmacy.yaml' 2026-09-01T00:40:33,560 adding 'lm_eval/tasks/mmmu/mmmu_physics.yaml' 2026-09-01T00:40:33,561 adding 'lm_eval/tasks/mmmu/mmmu_psychology.yaml' 2026-09-01T00:40:33,562 adding 'lm_eval/tasks/mmmu/mmmu_public_health.yaml' 2026-09-01T00:40:33,563 adding 'lm_eval/tasks/mmmu/mmmu_sociology.yaml' 2026-09-01T00:40:33,565 adding 'lm_eval/tasks/mmmu/utils.py' 2026-09-01T00:40:33,569 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py' 2026-09-01T00:40:33,570 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml' 2026-09-01T00:40:33,571 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml' 2026-09-01T00:40:33,572 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml' 2026-09-01T00:40:33,573 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml' 2026-09-01T00:40:33,574 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml' 2026-09-01T00:40:33,576 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml' 2026-09-01T00:40:33,577 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml' 2026-09-01T00:40:33,578 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml' 2026-09-01T00:40:33,579 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml' 2026-09-01T00:40:33,580 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml' 2026-09-01T00:40:33,582 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml' 2026-09-01T00:40:33,583 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml' 2026-09-01T00:40:33,584 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml' 2026-09-01T00:40:33,585 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml' 2026-09-01T00:40:33,586 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml' 2026-09-01T00:40:33,588 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml' 2026-09-01T00:40:33,589 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml' 2026-09-01T00:40:33,590 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml' 2026-09-01T00:40:33,591 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml' 2026-09-01T00:40:33,592 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml' 2026-09-01T00:40:33,593 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml' 2026-09-01T00:40:33,595 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml' 2026-09-01T00:40:33,596 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml' 2026-09-01T00:40:33,597 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml' 2026-09-01T00:40:33,598 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml' 2026-09-01T00:40:33,599 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml' 2026-09-01T00:40:33,600 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml' 2026-09-01T00:40:33,602 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml' 2026-09-01T00:40:33,603 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml' 2026-09-01T00:40:33,604 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml' 2026-09-01T00:40:33,605 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml' 2026-09-01T00:40:33,606 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml' 2026-09-01T00:40:33,607 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml' 2026-09-01T00:40:33,608 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml' 2026-09-01T00:40:33,609 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml' 2026-09-01T00:40:33,611 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml' 2026-09-01T00:40:33,612 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml' 2026-09-01T00:40:33,613 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml' 2026-09-01T00:40:33,614 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml' 2026-09-01T00:40:33,615 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml' 2026-09-01T00:40:33,616 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml' 2026-09-01T00:40:33,618 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml' 2026-09-01T00:40:33,619 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml' 2026-09-01T00:40:33,620 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml' 2026-09-01T00:40:33,621 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml' 2026-09-01T00:40:33,622 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml' 2026-09-01T00:40:33,623 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml' 2026-09-01T00:40:33,624 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml' 2026-09-01T00:40:33,626 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml' 2026-09-01T00:40:33,627 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml' 2026-09-01T00:40:33,632 adding 'lm_eval/tasks/model_written_evals/persona/_generate_configs.py' 2026-09-01T00:40:33,633 adding 'lm_eval/tasks/model_written_evals/persona/_template_yaml' 2026-09-01T00:40:33,634 adding 'lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml' 2026-09-01T00:40:33,635 adding 'lm_eval/tasks/model_written_evals/persona/agreeableness.yaml' 2026-09-01T00:40:33,636 adding 'lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml' 2026-09-01T00:40:33,638 adding 'lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml' 2026-09-01T00:40:33,639 adding 'lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml' 2026-09-01T00:40:33,640 adding 'lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml' 2026-09-01T00:40:33,641 adding 'lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml' 2026-09-01T00:40:33,642 adding 'lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml' 2026-09-01T00:40:33,643 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml' 2026-09-01T00:40:33,645 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml' 2026-09-01T00:40:33,646 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml' 2026-09-01T00:40:33,647 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml' 2026-09-01T00:40:33,648 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml' 2026-09-01T00:40:33,649 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml' 2026-09-01T00:40:33,650 adding 'lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml' 2026-09-01T00:40:33,652 adding 'lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml' 2026-09-01T00:40:33,653 adding 'lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml' 2026-09-01T00:40:33,654 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml' 2026-09-01T00:40:33,655 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml' 2026-09-01T00:40:33,656 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml' 2026-09-01T00:40:33,657 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml' 2026-09-01T00:40:33,658 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml' 2026-09-01T00:40:33,660 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml' 2026-09-01T00:40:33,661 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml' 2026-09-01T00:40:33,662 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml' 2026-09-01T00:40:33,663 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml' 2026-09-01T00:40:33,664 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml' 2026-09-01T00:40:33,665 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml' 2026-09-01T00:40:33,667 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml' 2026-09-01T00:40:33,668 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml' 2026-09-01T00:40:33,669 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml' 2026-09-01T00:40:33,670 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml' 2026-09-01T00:40:33,671 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml' 2026-09-01T00:40:33,672 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml' 2026-09-01T00:40:33,674 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml' 2026-09-01T00:40:33,675 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml' 2026-09-01T00:40:33,676 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml' 2026-09-01T00:40:33,677 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml' 2026-09-01T00:40:33,678 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml' 2026-09-01T00:40:33,679 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml' 2026-09-01T00:40:33,681 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml' 2026-09-01T00:40:33,682 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml' 2026-09-01T00:40:33,683 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml' 2026-09-01T00:40:33,684 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml' 2026-09-01T00:40:33,685 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml' 2026-09-01T00:40:33,686 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml' 2026-09-01T00:40:33,687 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml' 2026-09-01T00:40:33,689 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml' 2026-09-01T00:40:33,690 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml' 2026-09-01T00:40:33,691 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml' 2026-09-01T00:40:33,692 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml' 2026-09-01T00:40:33,693 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml' 2026-09-01T00:40:33,694 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml' 2026-09-01T00:40:33,696 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml' 2026-09-01T00:40:33,697 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml' 2026-09-01T00:40:33,698 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml' 2026-09-01T00:40:33,699 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml' 2026-09-01T00:40:33,700 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml' 2026-09-01T00:40:33,701 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml' 2026-09-01T00:40:33,702 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml' 2026-09-01T00:40:33,703 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml' 2026-09-01T00:40:33,705 adding 'lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml' 2026-09-01T00:40:33,706 adding 'lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml' 2026-09-01T00:40:33,707 adding 'lm_eval/tasks/model_written_evals/persona/extraversion.yaml' 2026-09-01T00:40:33,708 adding 'lm_eval/tasks/model_written_evals/persona/has-disability.yaml' 2026-09-01T00:40:33,709 adding 'lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml' 2026-09-01T00:40:33,710 adding 'lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml' 2026-09-01T00:40:33,711 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml' 2026-09-01T00:40:33,713 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml' 2026-09-01T00:40:33,714 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml' 2026-09-01T00:40:33,715 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml' 2026-09-01T00:40:33,716 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml' 2026-09-01T00:40:33,717 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml' 2026-09-01T00:40:33,719 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml' 2026-09-01T00:40:33,720 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml' 2026-09-01T00:40:33,721 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml' 2026-09-01T00:40:33,722 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml' 2026-09-01T00:40:33,723 adding 'lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml' 2026-09-01T00:40:33,724 adding 'lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml' 2026-09-01T00:40:33,725 adding 'lm_eval/tasks/model_written_evals/persona/narcissism.yaml' 2026-09-01T00:40:33,726 adding 'lm_eval/tasks/model_written_evals/persona/neuroticism.yaml' 2026-09-01T00:40:33,728 adding 'lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml' 2026-09-01T00:40:33,729 adding 'lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml' 2026-09-01T00:40:33,730 adding 'lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml' 2026-09-01T00:40:33,731 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml' 2026-09-01T00:40:33,732 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml' 2026-09-01T00:40:33,733 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml' 2026-09-01T00:40:33,734 adding 'lm_eval/tasks/model_written_evals/persona/openness.yaml' 2026-09-01T00:40:33,736 adding 'lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml' 2026-09-01T00:40:33,737 adding 'lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml' 2026-09-01T00:40:33,738 adding 'lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml' 2026-09-01T00:40:33,739 adding 'lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml' 2026-09-01T00:40:33,740 adding 'lm_eval/tasks/model_written_evals/persona/psychopathy.yaml' 2026-09-01T00:40:33,741 adding 'lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml' 2026-09-01T00:40:33,742 adding 'lm_eval/tasks/model_written_evals/persona/risk-averse.yaml' 2026-09-01T00:40:33,744 adding 'lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml' 2026-09-01T00:40:33,745 adding 'lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml' 2026-09-01T00:40:33,746 adding 'lm_eval/tasks/model_written_evals/persona/self-replication.yaml' 2026-09-01T00:40:33,747 adding 'lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml' 2026-09-01T00:40:33,748 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml' 2026-09-01T00:40:33,750 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml' 2026-09-01T00:40:33,751 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml' 2026-09-01T00:40:33,752 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml' 2026-09-01T00:40:33,753 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml' 2026-09-01T00:40:33,754 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml' 2026-09-01T00:40:33,755 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml' 2026-09-01T00:40:33,757 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml' 2026-09-01T00:40:33,758 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml' 2026-09-01T00:40:33,759 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml' 2026-09-01T00:40:33,760 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml' 2026-09-01T00:40:33,761 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml' 2026-09-01T00:40:33,763 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml' 2026-09-01T00:40:33,764 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml' 2026-09-01T00:40:33,765 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml' 2026-09-01T00:40:33,766 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml' 2026-09-01T00:40:33,767 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml' 2026-09-01T00:40:33,768 adding 'lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml' 2026-09-01T00:40:33,770 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml' 2026-09-01T00:40:33,771 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml' 2026-09-01T00:40:33,772 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml' 2026-09-01T00:40:33,773 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml' 2026-09-01T00:40:33,774 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml' 2026-09-01T00:40:33,775 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml' 2026-09-01T00:40:33,777 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml' 2026-09-01T00:40:33,778 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml' 2026-09-01T00:40:33,779 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml' 2026-09-01T00:40:33,780 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml' 2026-09-01T00:40:33,781 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml' 2026-09-01T00:40:33,782 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml' 2026-09-01T00:40:33,783 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml' 2026-09-01T00:40:33,785 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml' 2026-09-01T00:40:33,786 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml' 2026-09-01T00:40:33,787 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml' 2026-09-01T00:40:33,788 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml' 2026-09-01T00:40:33,790 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml' 2026-09-01T00:40:33,791 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml' 2026-09-01T00:40:33,793 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml' 2026-09-01T00:40:33,794 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml' 2026-09-01T00:40:33,796 adding 'lm_eval/tasks/model_written_evals/winogenerated/winogenerated' 2026-09-01T00:40:33,798 adding 'lm_eval/tasks/moral_stories/README.md' 2026-09-01T00:40:33,799 adding 'lm_eval/tasks/moral_stories/moral_stories.yaml' 2026-09-01T00:40:33,800 adding 'lm_eval/tasks/moral_stories/utils.py' 2026-09-01T00:40:33,802 adding 'lm_eval/tasks/mts_dialog/README.md' 2026-09-01T00:40:33,804 adding 'lm_eval/tasks/mts_dialog/mts_dialog.yaml' 2026-09-01T00:40:33,805 adding 'lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml' 2026-09-01T00:40:33,806 adding 'lm_eval/tasks/mts_dialog/utils.py' 2026-09-01T00:40:33,807 adding 'lm_eval/tasks/mts_dialog/utils_perplexity.py' 2026-09-01T00:40:33,811 adding 'lm_eval/tasks/multiblimp/README.md' 2026-09-01T00:40:33,813 adding 'lm_eval/tasks/multiblimp/_template_yaml' 2026-09-01T00:40:33,814 adding 'lm_eval/tasks/multiblimp/multiblimp_abk.yaml' 2026-09-01T00:40:33,816 adding 'lm_eval/tasks/multiblimp/multiblimp_aln.yaml' 2026-09-01T00:40:33,817 adding 'lm_eval/tasks/multiblimp/multiblimp_amh.yaml' 2026-09-01T00:40:33,818 adding 'lm_eval/tasks/multiblimp/multiblimp_apu.yaml' 2026-09-01T00:40:33,819 adding 'lm_eval/tasks/multiblimp/multiblimp_aqz.yaml' 2026-09-01T00:40:33,820 adding 'lm_eval/tasks/multiblimp/multiblimp_arb.yaml' 2026-09-01T00:40:33,821 adding 'lm_eval/tasks/multiblimp/multiblimp_azz.yaml' 2026-09-01T00:40:33,823 adding 'lm_eval/tasks/multiblimp/multiblimp_bel.yaml' 2026-09-01T00:40:33,824 adding 'lm_eval/tasks/multiblimp/multiblimp_ben.yaml' 2026-09-01T00:40:33,825 adding 'lm_eval/tasks/multiblimp/multiblimp_bho.yaml' 2026-09-01T00:40:33,826 adding 'lm_eval/tasks/multiblimp/multiblimp_bor.yaml' 2026-09-01T00:40:33,827 adding 'lm_eval/tasks/multiblimp/multiblimp_bre.yaml' 2026-09-01T00:40:33,828 adding 'lm_eval/tasks/multiblimp/multiblimp_bua.yaml' 2026-09-01T00:40:33,829 adding 'lm_eval/tasks/multiblimp/multiblimp_bul.yaml' 2026-09-01T00:40:33,830 adding 'lm_eval/tasks/multiblimp/multiblimp_cat.yaml' 2026-09-01T00:40:33,831 adding 'lm_eval/tasks/multiblimp/multiblimp_ces.yaml' 2026-09-01T00:40:33,832 adding 'lm_eval/tasks/multiblimp/multiblimp_chu.yaml' 2026-09-01T00:40:33,833 adding 'lm_eval/tasks/multiblimp/multiblimp_cym.yaml' 2026-09-01T00:40:33,835 adding 'lm_eval/tasks/multiblimp/multiblimp_dan.yaml' 2026-09-01T00:40:33,836 adding 'lm_eval/tasks/multiblimp/multiblimp_deu.yaml' 2026-09-01T00:40:33,837 adding 'lm_eval/tasks/multiblimp/multiblimp_egy.yaml' 2026-09-01T00:40:33,838 adding 'lm_eval/tasks/multiblimp/multiblimp_ell.yaml' 2026-09-01T00:40:33,839 adding 'lm_eval/tasks/multiblimp/multiblimp_eng.yaml' 2026-09-01T00:40:33,840 adding 'lm_eval/tasks/multiblimp/multiblimp_est.yaml' 2026-09-01T00:40:33,841 adding 'lm_eval/tasks/multiblimp/multiblimp_eus.yaml' 2026-09-01T00:40:33,842 adding 'lm_eval/tasks/multiblimp/multiblimp_fao.yaml' 2026-09-01T00:40:33,844 adding 'lm_eval/tasks/multiblimp/multiblimp_fas.yaml' 2026-09-01T00:40:33,845 adding 'lm_eval/tasks/multiblimp/multiblimp_fin.yaml' 2026-09-01T00:40:33,846 adding 'lm_eval/tasks/multiblimp/multiblimp_fra.yaml' 2026-09-01T00:40:33,847 adding 'lm_eval/tasks/multiblimp/multiblimp_frm.yaml' 2026-09-01T00:40:33,848 adding 'lm_eval/tasks/multiblimp/multiblimp_fro.yaml' 2026-09-01T00:40:33,849 adding 'lm_eval/tasks/multiblimp/multiblimp_gla.yaml' 2026-09-01T00:40:33,850 adding 'lm_eval/tasks/multiblimp/multiblimp_gle.yaml' 2026-09-01T00:40:33,851 adding 'lm_eval/tasks/multiblimp/multiblimp_glg.yaml' 2026-09-01T00:40:33,852 adding 'lm_eval/tasks/multiblimp/multiblimp_got.yaml' 2026-09-01T00:40:33,854 adding 'lm_eval/tasks/multiblimp/multiblimp_grc.yaml' 2026-09-01T00:40:33,855 adding 'lm_eval/tasks/multiblimp/multiblimp_guj.yaml' 2026-09-01T00:40:33,856 adding 'lm_eval/tasks/multiblimp/multiblimp_hbo.yaml' 2026-09-01T00:40:33,858 adding 'lm_eval/tasks/multiblimp/multiblimp_hbs.yaml' 2026-09-01T00:40:33,859 adding 'lm_eval/tasks/multiblimp/multiblimp_heb.yaml' 2026-09-01T00:40:33,860 adding 'lm_eval/tasks/multiblimp/multiblimp_hin.yaml' 2026-09-01T00:40:33,861 adding 'lm_eval/tasks/multiblimp/multiblimp_hit.yaml' 2026-09-01T00:40:33,862 adding 'lm_eval/tasks/multiblimp/multiblimp_hsb.yaml' 2026-09-01T00:40:33,863 adding 'lm_eval/tasks/multiblimp/multiblimp_hun.yaml' 2026-09-01T00:40:33,865 adding 'lm_eval/tasks/multiblimp/multiblimp_hye.yaml' 2026-09-01T00:40:33,866 adding 'lm_eval/tasks/multiblimp/multiblimp_hyw.yaml' 2026-09-01T00:40:33,867 adding 'lm_eval/tasks/multiblimp/multiblimp_isl.yaml' 2026-09-01T00:40:33,868 adding 'lm_eval/tasks/multiblimp/multiblimp_ita.yaml' 2026-09-01T00:40:33,869 adding 'lm_eval/tasks/multiblimp/multiblimp_kat.yaml' 2026-09-01T00:40:33,870 adding 'lm_eval/tasks/multiblimp/multiblimp_kaz.yaml' 2026-09-01T00:40:33,872 adding 'lm_eval/tasks/multiblimp/multiblimp_kir.yaml' 2026-09-01T00:40:33,873 adding 'lm_eval/tasks/multiblimp/multiblimp_kmr.yaml' 2026-09-01T00:40:33,874 adding 'lm_eval/tasks/multiblimp/multiblimp_koi.yaml' 2026-09-01T00:40:33,875 adding 'lm_eval/tasks/multiblimp/multiblimp_kpv.yaml' 2026-09-01T00:40:33,876 adding 'lm_eval/tasks/multiblimp/multiblimp_krl.yaml' 2026-09-01T00:40:33,877 adding 'lm_eval/tasks/multiblimp/multiblimp_kxh.yaml' 2026-09-01T00:40:33,878 adding 'lm_eval/tasks/multiblimp/multiblimp_lat.yaml' 2026-09-01T00:40:33,879 adding 'lm_eval/tasks/multiblimp/multiblimp_lav.yaml' 2026-09-01T00:40:33,880 adding 'lm_eval/tasks/multiblimp/multiblimp_lij.yaml' 2026-09-01T00:40:33,881 adding 'lm_eval/tasks/multiblimp/multiblimp_lit.yaml' 2026-09-01T00:40:33,882 adding 'lm_eval/tasks/multiblimp/multiblimp_mar.yaml' 2026-09-01T00:40:33,883 adding 'lm_eval/tasks/multiblimp/multiblimp_mdf.yaml' 2026-09-01T00:40:33,884 adding 'lm_eval/tasks/multiblimp/multiblimp_mkd.yaml' 2026-09-01T00:40:33,886 adding 'lm_eval/tasks/multiblimp/multiblimp_myv.yaml' 2026-09-01T00:40:33,887 adding 'lm_eval/tasks/multiblimp/multiblimp_nds.yaml' 2026-09-01T00:40:33,888 adding 'lm_eval/tasks/multiblimp/multiblimp_nhi.yaml' 2026-09-01T00:40:33,889 adding 'lm_eval/tasks/multiblimp/multiblimp_nld.yaml' 2026-09-01T00:40:33,890 adding 'lm_eval/tasks/multiblimp/multiblimp_olo.yaml' 2026-09-01T00:40:33,891 adding 'lm_eval/tasks/multiblimp/multiblimp_orv.yaml' 2026-09-01T00:40:33,892 adding 'lm_eval/tasks/multiblimp/multiblimp_ota.yaml' 2026-09-01T00:40:33,893 adding 'lm_eval/tasks/multiblimp/multiblimp_pcm.yaml' 2026-09-01T00:40:33,894 adding 'lm_eval/tasks/multiblimp/multiblimp_pol.yaml' 2026-09-01T00:40:33,895 adding 'lm_eval/tasks/multiblimp/multiblimp_por.yaml' 2026-09-01T00:40:33,896 adding 'lm_eval/tasks/multiblimp/multiblimp_quc.yaml' 2026-09-01T00:40:33,898 adding 'lm_eval/tasks/multiblimp/multiblimp_ron.yaml' 2026-09-01T00:40:33,899 adding 'lm_eval/tasks/multiblimp/multiblimp_rus.yaml' 2026-09-01T00:40:33,900 adding 'lm_eval/tasks/multiblimp/multiblimp_sah.yaml' 2026-09-01T00:40:33,901 adding 'lm_eval/tasks/multiblimp/multiblimp_san.yaml' 2026-09-01T00:40:33,902 adding 'lm_eval/tasks/multiblimp/multiblimp_slk.yaml' 2026-09-01T00:40:33,903 adding 'lm_eval/tasks/multiblimp/multiblimp_slv.yaml' 2026-09-01T00:40:33,904 adding 'lm_eval/tasks/multiblimp/multiblimp_sme.yaml' 2026-09-01T00:40:33,906 adding 'lm_eval/tasks/multiblimp/multiblimp_sms.yaml' 2026-09-01T00:40:33,907 adding 'lm_eval/tasks/multiblimp/multiblimp_spa.yaml' 2026-09-01T00:40:33,908 adding 'lm_eval/tasks/multiblimp/multiblimp_sqi.yaml' 2026-09-01T00:40:33,909 adding 'lm_eval/tasks/multiblimp/multiblimp_swe.yaml' 2026-09-01T00:40:33,910 adding 'lm_eval/tasks/multiblimp/multiblimp_tam.yaml' 2026-09-01T00:40:33,911 adding 'lm_eval/tasks/multiblimp/multiblimp_tpn.yaml' 2026-09-01T00:40:33,912 adding 'lm_eval/tasks/multiblimp/multiblimp_ttc.yaml' 2026-09-01T00:40:33,913 adding 'lm_eval/tasks/multiblimp/multiblimp_tur.yaml' 2026-09-01T00:40:33,915 adding 'lm_eval/tasks/multiblimp/multiblimp_uig.yaml' 2026-09-01T00:40:33,916 adding 'lm_eval/tasks/multiblimp/multiblimp_ukr.yaml' 2026-09-01T00:40:33,917 adding 'lm_eval/tasks/multiblimp/multiblimp_urb.yaml' 2026-09-01T00:40:33,918 adding 'lm_eval/tasks/multiblimp/multiblimp_urd.yaml' 2026-09-01T00:40:33,919 adding 'lm_eval/tasks/multiblimp/multiblimp_uzb.yaml' 2026-09-01T00:40:33,920 adding 'lm_eval/tasks/multiblimp/multiblimp_vep.yaml' 2026-09-01T00:40:33,921 adding 'lm_eval/tasks/multiblimp/multiblimp_wbp.yaml' 2026-09-01T00:40:33,923 adding 'lm_eval/tasks/multiblimp/multiblimp_wol.yaml' 2026-09-01T00:40:33,924 adding 'lm_eval/tasks/multiblimp/multiblimp_xcl.yaml' 2026-09-01T00:40:33,925 adding 'lm_eval/tasks/multiblimp/multiblimp_xnr.yaml' 2026-09-01T00:40:33,926 adding 'lm_eval/tasks/multiblimp/multiblimp_xpg.yaml' 2026-09-01T00:40:33,927 adding 'lm_eval/tasks/multiblimp/multiblimp_yrl.yaml' 2026-09-01T00:40:33,929 adding 'lm_eval/tasks/mutual/README.md' 2026-09-01T00:40:33,930 adding 'lm_eval/tasks/mutual/multual_plus.yaml' 2026-09-01T00:40:33,932 adding 'lm_eval/tasks/mutual/mutual.yaml' 2026-09-01T00:40:33,933 adding 'lm_eval/tasks/mutual/utils.py' 2026-09-01T00:40:33,935 adding 'lm_eval/tasks/nerel-bench/README.md' 2026-09-01T00:40:33,937 adding 'lm_eval/tasks/nerel-bench/_template_yaml' 2026-09-01T00:40:33,938 adding 'lm_eval/tasks/nerel-bench/ru_entity_definition.yaml' 2026-09-01T00:40:33,939 adding 'lm_eval/tasks/nerel-bench/ru_entity_recognition.yaml' 2026-09-01T00:40:33,940 adding 'lm_eval/tasks/nerel-bench/ru_relation_definition.yaml' 2026-09-01T00:40:33,941 adding 'lm_eval/tasks/nerel-bench/ru_relation_extraction.yaml' 2026-09-01T00:40:33,949 adding 'lm_eval/tasks/nerel-bench/utils.py' 2026-09-01T00:40:33,951 adding 'lm_eval/tasks/noreval/README.md' 2026-09-01T00:40:34,032 adding 'lm_eval/tasks/noreval/noreval.jpg' 2026-09-01T00:40:34,039 adding 'lm_eval/tasks/noreval/ask_gec/README.md' 2026-09-01T00:40:34,040 adding 'lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml' 2026-09-01T00:40:34,041 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml' 2026-09-01T00:40:34,042 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml' 2026-09-01T00:40:34,043 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml' 2026-09-01T00:40:34,045 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml' 2026-09-01T00:40:34,046 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml' 2026-09-01T00:40:34,047 adding 'lm_eval/tasks/noreval/ask_gec/errant.py' 2026-09-01T00:40:34,049 adding 'lm_eval/tasks/noreval/ncb/ncb.yaml' 2026-09-01T00:40:34,051 adding 'lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml' 2026-09-01T00:40:34,052 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml' 2026-09-01T00:40:34,053 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml' 2026-09-01T00:40:34,054 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml' 2026-09-01T00:40:34,056 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml' 2026-09-01T00:40:34,057 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml' 2026-09-01T00:40:34,058 adding 'lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml' 2026-09-01T00:40:34,060 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml' 2026-09-01T00:40:34,061 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml' 2026-09-01T00:40:34,063 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml' 2026-09-01T00:40:34,064 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml' 2026-09-01T00:40:34,065 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml' 2026-09-01T00:40:34,067 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml' 2026-09-01T00:40:34,068 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml' 2026-09-01T00:40:34,069 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml' 2026-09-01T00:40:34,071 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml' 2026-09-01T00:40:34,072 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml' 2026-09-01T00:40:34,074 adding 'lm_eval/tasks/noreval/norec/_norec_yaml' 2026-09-01T00:40:34,075 adding 'lm_eval/tasks/noreval/norec/utils.py' 2026-09-01T00:40:34,077 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml' 2026-09-01T00:40:34,078 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml' 2026-09-01T00:40:34,079 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml' 2026-09-01T00:40:34,081 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml' 2026-09-01T00:40:34,082 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml' 2026-09-01T00:40:34,084 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml' 2026-09-01T00:40:34,085 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml' 2026-09-01T00:40:34,086 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml' 2026-09-01T00:40:34,088 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml' 2026-09-01T00:40:34,089 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml' 2026-09-01T00:40:34,091 adding 'lm_eval/tasks/noreval/noridiom/_noridiom_yaml' 2026-09-01T00:40:34,092 adding 'lm_eval/tasks/noreval/noridiom/utils.py' 2026-09-01T00:40:34,093 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml' 2026-09-01T00:40:34,095 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml' 2026-09-01T00:40:34,096 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml' 2026-09-01T00:40:34,097 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml' 2026-09-01T00:40:34,098 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml' 2026-09-01T00:40:34,100 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml' 2026-09-01T00:40:34,101 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml' 2026-09-01T00:40:34,102 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml' 2026-09-01T00:40:34,103 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml' 2026-09-01T00:40:34,105 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml' 2026-09-01T00:40:34,107 adding 'lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml' 2026-09-01T00:40:34,108 adding 'lm_eval/tasks/noreval/noropenbookqa/utils.py' 2026-09-01T00:40:34,109 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml' 2026-09-01T00:40:34,111 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml' 2026-09-01T00:40:34,112 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml' 2026-09-01T00:40:34,113 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml' 2026-09-01T00:40:34,114 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml' 2026-09-01T00:40:34,116 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml' 2026-09-01T00:40:34,117 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml' 2026-09-01T00:40:34,118 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml' 2026-09-01T00:40:34,119 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml' 2026-09-01T00:40:34,121 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml' 2026-09-01T00:40:34,122 adding 'lm_eval/tasks/noreval/norquad/_norquad_yaml' 2026-09-01T00:40:34,124 adding 'lm_eval/tasks/noreval/norquad/norquad_p0.yaml' 2026-09-01T00:40:34,125 adding 'lm_eval/tasks/noreval/norquad/norquad_p1.yaml' 2026-09-01T00:40:34,126 adding 'lm_eval/tasks/noreval/norquad/norquad_p2.yaml' 2026-09-01T00:40:34,127 adding 'lm_eval/tasks/noreval/norquad/norquad_p3.yaml' 2026-09-01T00:40:34,128 adding 'lm_eval/tasks/noreval/norquad/norquad_p4.yaml' 2026-09-01T00:40:34,129 adding 'lm_eval/tasks/noreval/norquad/utils.py' 2026-09-01T00:40:34,131 adding 'lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml' 2026-09-01T00:40:34,133 adding 'lm_eval/tasks/noreval/norsumm/_norsumm_yaml' 2026-09-01T00:40:34,135 adding 'lm_eval/tasks/noreval/norsumm/utils.py' 2026-09-01T00:40:34,136 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml' 2026-09-01T00:40:34,138 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml' 2026-09-01T00:40:34,139 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml' 2026-09-01T00:40:34,140 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml' 2026-09-01T00:40:34,141 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml' 2026-09-01T00:40:34,142 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml' 2026-09-01T00:40:34,144 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml' 2026-09-01T00:40:34,145 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml' 2026-09-01T00:40:34,147 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml' 2026-09-01T00:40:34,148 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml' 2026-09-01T00:40:34,149 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml' 2026-09-01T00:40:34,150 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml' 2026-09-01T00:40:34,152 adding 'lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml' 2026-09-01T00:40:34,154 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml' 2026-09-01T00:40:34,155 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py' 2026-09-01T00:40:34,157 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml' 2026-09-01T00:40:34,158 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml' 2026-09-01T00:40:34,159 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml' 2026-09-01T00:40:34,160 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml' 2026-09-01T00:40:34,162 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml' 2026-09-01T00:40:34,163 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml' 2026-09-01T00:40:34,164 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml' 2026-09-01T00:40:34,166 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml' 2026-09-01T00:40:34,167 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml' 2026-09-01T00:40:34,168 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml' 2026-09-01T00:40:34,170 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml' 2026-09-01T00:40:34,171 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml' 2026-09-01T00:40:34,173 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml' 2026-09-01T00:40:34,174 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml' 2026-09-01T00:40:34,175 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml' 2026-09-01T00:40:34,176 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml' 2026-09-01T00:40:34,177 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py' 2026-09-01T00:40:34,179 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml' 2026-09-01T00:40:34,180 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml' 2026-09-01T00:40:34,181 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml' 2026-09-01T00:40:34,182 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml' 2026-09-01T00:40:34,184 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml' 2026-09-01T00:40:34,185 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py' 2026-09-01T00:40:34,187 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml' 2026-09-01T00:40:34,188 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml' 2026-09-01T00:40:34,190 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml' 2026-09-01T00:40:34,191 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml' 2026-09-01T00:40:34,192 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml' 2026-09-01T00:40:34,193 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml' 2026-09-01T00:40:34,194 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py' 2026-09-01T00:40:34,196 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml' 2026-09-01T00:40:34,197 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml' 2026-09-01T00:40:34,199 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml' 2026-09-01T00:40:34,200 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml' 2026-09-01T00:40:34,201 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml' 2026-09-01T00:40:34,202 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py' 2026-09-01T00:40:34,204 adding 'lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml' 2026-09-01T00:40:34,205 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml' 2026-09-01T00:40:34,207 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml' 2026-09-01T00:40:34,208 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml' 2026-09-01T00:40:34,209 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml' 2026-09-01T00:40:34,211 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml' 2026-09-01T00:40:34,212 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml' 2026-09-01T00:40:34,213 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml' 2026-09-01T00:40:34,214 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml' 2026-09-01T00:40:34,216 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml' 2026-09-01T00:40:34,217 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml' 2026-09-01T00:40:34,218 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml' 2026-09-01T00:40:34,219 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml' 2026-09-01T00:40:34,221 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml' 2026-09-01T00:40:34,222 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml' 2026-09-01T00:40:34,223 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml' 2026-09-01T00:40:34,224 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml' 2026-09-01T00:40:34,226 adding 'lm_eval/tasks/noticia/README.md' 2026-09-01T00:40:34,227 adding 'lm_eval/tasks/noticia/noticia.yaml' 2026-09-01T00:40:34,229 adding 'lm_eval/tasks/noticia/utils.py' 2026-09-01T00:40:34,231 adding 'lm_eval/tasks/nq_open/README.md' 2026-09-01T00:40:34,232 adding 'lm_eval/tasks/nq_open/nq_open.yaml' 2026-09-01T00:40:34,235 adding 'lm_eval/tasks/okapi/arc_multilingual/README.md' 2026-09-01T00:40:34,236 adding 'lm_eval/tasks/okapi/arc_multilingual/_arc_yaml' 2026-09-01T00:40:34,237 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml' 2026-09-01T00:40:34,238 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml' 2026-09-01T00:40:34,240 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml' 2026-09-01T00:40:34,241 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml' 2026-09-01T00:40:34,242 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml' 2026-09-01T00:40:34,243 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml' 2026-09-01T00:40:34,244 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml' 2026-09-01T00:40:34,246 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml' 2026-09-01T00:40:34,247 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml' 2026-09-01T00:40:34,248 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml' 2026-09-01T00:40:34,249 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml' 2026-09-01T00:40:34,250 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml' 2026-09-01T00:40:34,251 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml' 2026-09-01T00:40:34,252 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml' 2026-09-01T00:40:34,254 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml' 2026-09-01T00:40:34,255 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml' 2026-09-01T00:40:34,256 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml' 2026-09-01T00:40:34,257 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml' 2026-09-01T00:40:34,259 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml' 2026-09-01T00:40:34,260 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml' 2026-09-01T00:40:34,261 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml' 2026-09-01T00:40:34,262 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml' 2026-09-01T00:40:34,263 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml' 2026-09-01T00:40:34,264 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml' 2026-09-01T00:40:34,265 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml' 2026-09-01T00:40:34,267 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml' 2026-09-01T00:40:34,268 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml' 2026-09-01T00:40:34,269 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml' 2026-09-01T00:40:34,270 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml' 2026-09-01T00:40:34,271 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml' 2026-09-01T00:40:34,273 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml' 2026-09-01T00:40:34,274 adding 'lm_eval/tasks/okapi/arc_multilingual/utils.py' 2026-09-01T00:40:34,276 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/README.md' 2026-09-01T00:40:34,278 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml' 2026-09-01T00:40:34,279 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml' 2026-09-01T00:40:34,280 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml' 2026-09-01T00:40:34,281 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml' 2026-09-01T00:40:34,282 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml' 2026-09-01T00:40:34,283 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml' 2026-09-01T00:40:34,284 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml' 2026-09-01T00:40:34,285 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml' 2026-09-01T00:40:34,287 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml' 2026-09-01T00:40:34,288 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml' 2026-09-01T00:40:34,289 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml' 2026-09-01T00:40:34,290 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml' 2026-09-01T00:40:34,291 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml' 2026-09-01T00:40:34,292 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml' 2026-09-01T00:40:34,293 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml' 2026-09-01T00:40:34,294 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml' 2026-09-01T00:40:34,296 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml' 2026-09-01T00:40:34,297 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml' 2026-09-01T00:40:34,298 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml' 2026-09-01T00:40:34,299 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml' 2026-09-01T00:40:34,300 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml' 2026-09-01T00:40:34,301 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml' 2026-09-01T00:40:34,303 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml' 2026-09-01T00:40:34,304 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml' 2026-09-01T00:40:34,305 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml' 2026-09-01T00:40:34,306 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml' 2026-09-01T00:40:34,307 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml' 2026-09-01T00:40:34,309 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml' 2026-09-01T00:40:34,310 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml' 2026-09-01T00:40:34,311 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml' 2026-09-01T00:40:34,312 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml' 2026-09-01T00:40:34,313 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/utils.py' 2026-09-01T00:40:34,315 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml' 2026-09-01T00:40:34,317 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py' 2026-09-01T00:40:34,318 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml' 2026-09-01T00:40:34,319 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml' 2026-09-01T00:40:34,320 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml' 2026-09-01T00:40:34,321 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml' 2026-09-01T00:40:34,322 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml' 2026-09-01T00:40:34,323 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml' 2026-09-01T00:40:34,324 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml' 2026-09-01T00:40:34,325 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml' 2026-09-01T00:40:34,326 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml' 2026-09-01T00:40:34,327 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml' 2026-09-01T00:40:34,329 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml' 2026-09-01T00:40:34,330 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml' 2026-09-01T00:40:34,331 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml' 2026-09-01T00:40:34,332 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml' 2026-09-01T00:40:34,333 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml' 2026-09-01T00:40:34,334 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml' 2026-09-01T00:40:34,335 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml' 2026-09-01T00:40:34,336 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml' 2026-09-01T00:40:34,337 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml' 2026-09-01T00:40:34,338 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml' 2026-09-01T00:40:34,340 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml' 2026-09-01T00:40:34,341 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml' 2026-09-01T00:40:34,342 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml' 2026-09-01T00:40:34,343 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml' 2026-09-01T00:40:34,344 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml' 2026-09-01T00:40:34,345 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml' 2026-09-01T00:40:34,346 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml' 2026-09-01T00:40:34,348 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml' 2026-09-01T00:40:34,349 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml' 2026-09-01T00:40:34,350 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml' 2026-09-01T00:40:34,351 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml' 2026-09-01T00:40:34,352 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml' 2026-09-01T00:40:34,353 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml' 2026-09-01T00:40:34,354 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml' 2026-09-01T00:40:34,357 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/README.md' 2026-09-01T00:40:34,359 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml' 2026-09-01T00:40:34,360 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml' 2026-09-01T00:40:34,361 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml' 2026-09-01T00:40:34,362 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml' 2026-09-01T00:40:34,363 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml' 2026-09-01T00:40:34,365 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml' 2026-09-01T00:40:34,366 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml' 2026-09-01T00:40:34,367 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml' 2026-09-01T00:40:34,368 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml' 2026-09-01T00:40:34,369 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml' 2026-09-01T00:40:34,370 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml' 2026-09-01T00:40:34,371 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml' 2026-09-01T00:40:34,372 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml' 2026-09-01T00:40:34,373 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml' 2026-09-01T00:40:34,375 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml' 2026-09-01T00:40:34,376 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml' 2026-09-01T00:40:34,377 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml' 2026-09-01T00:40:34,378 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml' 2026-09-01T00:40:34,379 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml' 2026-09-01T00:40:34,380 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml' 2026-09-01T00:40:34,381 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml' 2026-09-01T00:40:34,382 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml' 2026-09-01T00:40:34,384 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml' 2026-09-01T00:40:34,385 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml' 2026-09-01T00:40:34,386 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml' 2026-09-01T00:40:34,387 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml' 2026-09-01T00:40:34,388 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml' 2026-09-01T00:40:34,389 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml' 2026-09-01T00:40:34,391 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml' 2026-09-01T00:40:34,392 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml' 2026-09-01T00:40:34,393 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml' 2026-09-01T00:40:34,394 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml' 2026-09-01T00:40:34,395 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml' 2026-09-01T00:40:34,396 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml' 2026-09-01T00:40:34,398 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml' 2026-09-01T00:40:34,399 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml' 2026-09-01T00:40:34,400 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml' 2026-09-01T00:40:34,401 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml' 2026-09-01T00:40:34,402 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml' 2026-09-01T00:40:34,403 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml' 2026-09-01T00:40:34,405 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml' 2026-09-01T00:40:34,406 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml' 2026-09-01T00:40:34,407 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml' 2026-09-01T00:40:34,408 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml' 2026-09-01T00:40:34,409 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml' 2026-09-01T00:40:34,410 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml' 2026-09-01T00:40:34,412 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml' 2026-09-01T00:40:34,413 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml' 2026-09-01T00:40:34,414 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml' 2026-09-01T00:40:34,415 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml' 2026-09-01T00:40:34,416 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml' 2026-09-01T00:40:34,417 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml' 2026-09-01T00:40:34,418 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml' 2026-09-01T00:40:34,419 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml' 2026-09-01T00:40:34,420 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml' 2026-09-01T00:40:34,422 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml' 2026-09-01T00:40:34,423 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml' 2026-09-01T00:40:34,424 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml' 2026-09-01T00:40:34,425 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml' 2026-09-01T00:40:34,426 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml' 2026-09-01T00:40:34,427 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml' 2026-09-01T00:40:34,429 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml' 2026-09-01T00:40:34,430 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml' 2026-09-01T00:40:34,431 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml' 2026-09-01T00:40:34,432 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py' 2026-09-01T00:40:34,434 adding 'lm_eval/tasks/olaph/README.md' 2026-09-01T00:40:34,435 adding 'lm_eval/tasks/olaph/olaph.yaml' 2026-09-01T00:40:34,436 adding 'lm_eval/tasks/olaph/olaph_perplexity.yaml' 2026-09-01T00:40:34,438 adding 'lm_eval/tasks/olaph/utils.py' 2026-09-01T00:40:34,439 adding 'lm_eval/tasks/olaph/utils_perplexity.py' 2026-09-01T00:40:34,441 adding 'lm_eval/tasks/openai-mmmlu/README.md' 2026-09-01T00:40:34,442 adding 'lm_eval/tasks/openai-mmmlu/_generate_configs.py' 2026-09-01T00:40:34,443 adding 'lm_eval/tasks/openai-mmmlu/languages.json' 2026-09-01T00:40:34,445 adding 'lm_eval/tasks/openai-mmmlu/subjects.json' 2026-09-01T00:40:34,503 adding 'lm_eval/tasks/openai-mmmlu/default/_default_template_yaml' 2026-09-01T00:40:34,504 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml' 2026-09-01T00:40:34,505 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml' 2026-09-01T00:40:34,506 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml' 2026-09-01T00:40:34,507 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml' 2026-09-01T00:40:34,509 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml' 2026-09-01T00:40:34,510 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml' 2026-09-01T00:40:34,511 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml' 2026-09-01T00:40:34,512 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml' 2026-09-01T00:40:34,513 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml' 2026-09-01T00:40:34,515 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml' 2026-09-01T00:40:34,516 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml' 2026-09-01T00:40:34,517 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml' 2026-09-01T00:40:34,518 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml' 2026-09-01T00:40:34,519 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml' 2026-09-01T00:40:34,520 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml' 2026-09-01T00:40:34,522 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml' 2026-09-01T00:40:34,523 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml' 2026-09-01T00:40:34,524 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml' 2026-09-01T00:40:34,525 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml' 2026-09-01T00:40:34,526 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml' 2026-09-01T00:40:34,527 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml' 2026-09-01T00:40:34,528 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml' 2026-09-01T00:40:34,529 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml' 2026-09-01T00:40:34,530 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml' 2026-09-01T00:40:34,532 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml' 2026-09-01T00:40:34,533 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml' 2026-09-01T00:40:34,534 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml' 2026-09-01T00:40:34,535 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml' 2026-09-01T00:40:34,536 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml' 2026-09-01T00:40:34,537 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml' 2026-09-01T00:40:34,539 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml' 2026-09-01T00:40:34,540 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml' 2026-09-01T00:40:34,541 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml' 2026-09-01T00:40:34,542 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml' 2026-09-01T00:40:34,543 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml' 2026-09-01T00:40:34,544 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml' 2026-09-01T00:40:34,545 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml' 2026-09-01T00:40:34,547 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml' 2026-09-01T00:40:34,548 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml' 2026-09-01T00:40:34,549 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml' 2026-09-01T00:40:34,550 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml' 2026-09-01T00:40:34,551 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml' 2026-09-01T00:40:34,552 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml' 2026-09-01T00:40:34,553 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml' 2026-09-01T00:40:34,555 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml' 2026-09-01T00:40:34,556 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml' 2026-09-01T00:40:34,557 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml' 2026-09-01T00:40:34,558 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml' 2026-09-01T00:40:34,559 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml' 2026-09-01T00:40:34,560 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml' 2026-09-01T00:40:34,562 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml' 2026-09-01T00:40:34,563 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml' 2026-09-01T00:40:34,564 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml' 2026-09-01T00:40:34,565 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml' 2026-09-01T00:40:34,567 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml' 2026-09-01T00:40:34,568 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml' 2026-09-01T00:40:34,569 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml' 2026-09-01T00:40:34,570 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml' 2026-09-01T00:40:34,572 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml' 2026-09-01T00:40:34,573 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml' 2026-09-01T00:40:34,574 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml' 2026-09-01T00:40:34,575 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml' 2026-09-01T00:40:34,576 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml' 2026-09-01T00:40:34,577 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml' 2026-09-01T00:40:34,578 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml' 2026-09-01T00:40:34,579 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml' 2026-09-01T00:40:34,580 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml' 2026-09-01T00:40:34,581 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml' 2026-09-01T00:40:34,582 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml' 2026-09-01T00:40:34,584 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml' 2026-09-01T00:40:34,585 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml' 2026-09-01T00:40:34,586 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml' 2026-09-01T00:40:34,587 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml' 2026-09-01T00:40:34,588 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml' 2026-09-01T00:40:34,589 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml' 2026-09-01T00:40:34,591 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml' 2026-09-01T00:40:34,592 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml' 2026-09-01T00:40:34,593 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml' 2026-09-01T00:40:34,594 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml' 2026-09-01T00:40:34,595 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml' 2026-09-01T00:40:34,597 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml' 2026-09-01T00:40:34,598 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml' 2026-09-01T00:40:34,599 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml' 2026-09-01T00:40:34,600 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml' 2026-09-01T00:40:34,602 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml' 2026-09-01T00:40:34,603 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml' 2026-09-01T00:40:34,604 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml' 2026-09-01T00:40:34,605 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml' 2026-09-01T00:40:34,606 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml' 2026-09-01T00:40:34,608 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml' 2026-09-01T00:40:34,609 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml' 2026-09-01T00:40:34,610 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml' 2026-09-01T00:40:34,611 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml' 2026-09-01T00:40:34,612 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml' 2026-09-01T00:40:34,614 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml' 2026-09-01T00:40:34,615 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml' 2026-09-01T00:40:34,616 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml' 2026-09-01T00:40:34,617 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml' 2026-09-01T00:40:34,618 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml' 2026-09-01T00:40:34,619 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml' 2026-09-01T00:40:34,621 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml' 2026-09-01T00:40:34,622 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml' 2026-09-01T00:40:34,623 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml' 2026-09-01T00:40:34,624 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml' 2026-09-01T00:40:34,625 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml' 2026-09-01T00:40:34,626 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml' 2026-09-01T00:40:34,627 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml' 2026-09-01T00:40:34,628 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml' 2026-09-01T00:40:34,630 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml' 2026-09-01T00:40:34,631 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml' 2026-09-01T00:40:34,632 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml' 2026-09-01T00:40:34,633 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml' 2026-09-01T00:40:34,634 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml' 2026-09-01T00:40:34,635 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml' 2026-09-01T00:40:34,637 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml' 2026-09-01T00:40:34,638 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml' 2026-09-01T00:40:34,639 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml' 2026-09-01T00:40:34,640 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml' 2026-09-01T00:40:34,641 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml' 2026-09-01T00:40:34,642 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml' 2026-09-01T00:40:34,644 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml' 2026-09-01T00:40:34,645 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml' 2026-09-01T00:40:34,646 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml' 2026-09-01T00:40:34,647 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml' 2026-09-01T00:40:34,649 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml' 2026-09-01T00:40:34,650 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml' 2026-09-01T00:40:34,651 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml' 2026-09-01T00:40:34,652 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml' 2026-09-01T00:40:34,653 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml' 2026-09-01T00:40:34,654 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml' 2026-09-01T00:40:34,656 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml' 2026-09-01T00:40:34,657 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml' 2026-09-01T00:40:34,658 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml' 2026-09-01T00:40:34,659 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml' 2026-09-01T00:40:34,660 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml' 2026-09-01T00:40:34,662 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml' 2026-09-01T00:40:34,663 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml' 2026-09-01T00:40:34,664 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml' 2026-09-01T00:40:34,665 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml' 2026-09-01T00:40:34,666 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml' 2026-09-01T00:40:34,668 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml' 2026-09-01T00:40:34,669 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml' 2026-09-01T00:40:34,670 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml' 2026-09-01T00:40:34,671 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml' 2026-09-01T00:40:34,672 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml' 2026-09-01T00:40:34,673 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml' 2026-09-01T00:40:34,674 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml' 2026-09-01T00:40:34,675 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml' 2026-09-01T00:40:34,677 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml' 2026-09-01T00:40:34,678 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml' 2026-09-01T00:40:34,679 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml' 2026-09-01T00:40:34,680 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml' 2026-09-01T00:40:34,681 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml' 2026-09-01T00:40:34,682 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml' 2026-09-01T00:40:34,684 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml' 2026-09-01T00:40:34,685 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml' 2026-09-01T00:40:34,686 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml' 2026-09-01T00:40:34,687 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml' 2026-09-01T00:40:34,689 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml' 2026-09-01T00:40:34,690 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml' 2026-09-01T00:40:34,691 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml' 2026-09-01T00:40:34,692 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml' 2026-09-01T00:40:34,693 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml' 2026-09-01T00:40:34,694 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml' 2026-09-01T00:40:34,696 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml' 2026-09-01T00:40:34,697 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml' 2026-09-01T00:40:34,698 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml' 2026-09-01T00:40:34,699 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml' 2026-09-01T00:40:34,700 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml' 2026-09-01T00:40:34,702 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml' 2026-09-01T00:40:34,703 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml' 2026-09-01T00:40:34,704 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml' 2026-09-01T00:40:34,705 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml' 2026-09-01T00:40:34,706 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml' 2026-09-01T00:40:34,708 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml' 2026-09-01T00:40:34,709 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml' 2026-09-01T00:40:34,710 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml' 2026-09-01T00:40:34,711 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml' 2026-09-01T00:40:34,712 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml' 2026-09-01T00:40:34,713 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml' 2026-09-01T00:40:34,714 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml' 2026-09-01T00:40:34,715 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml' 2026-09-01T00:40:34,717 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml' 2026-09-01T00:40:34,718 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml' 2026-09-01T00:40:34,719 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml' 2026-09-01T00:40:34,720 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml' 2026-09-01T00:40:34,721 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml' 2026-09-01T00:40:34,722 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml' 2026-09-01T00:40:34,723 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml' 2026-09-01T00:40:34,725 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml' 2026-09-01T00:40:34,726 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml' 2026-09-01T00:40:34,727 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml' 2026-09-01T00:40:34,728 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml' 2026-09-01T00:40:34,729 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml' 2026-09-01T00:40:34,730 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml' 2026-09-01T00:40:34,731 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml' 2026-09-01T00:40:34,733 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml' 2026-09-01T00:40:34,734 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml' 2026-09-01T00:40:34,735 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml' 2026-09-01T00:40:34,736 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml' 2026-09-01T00:40:34,737 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml' 2026-09-01T00:40:34,738 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml' 2026-09-01T00:40:34,740 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml' 2026-09-01T00:40:34,741 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml' 2026-09-01T00:40:34,742 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml' 2026-09-01T00:40:34,743 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml' 2026-09-01T00:40:34,744 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml' 2026-09-01T00:40:34,746 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml' 2026-09-01T00:40:34,747 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml' 2026-09-01T00:40:34,748 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml' 2026-09-01T00:40:34,749 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml' 2026-09-01T00:40:34,750 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml' 2026-09-01T00:40:34,751 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml' 2026-09-01T00:40:34,753 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml' 2026-09-01T00:40:34,754 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml' 2026-09-01T00:40:34,755 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml' 2026-09-01T00:40:34,756 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml' 2026-09-01T00:40:34,757 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml' 2026-09-01T00:40:34,758 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml' 2026-09-01T00:40:34,760 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml' 2026-09-01T00:40:34,761 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml' 2026-09-01T00:40:34,762 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml' 2026-09-01T00:40:34,763 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml' 2026-09-01T00:40:34,764 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml' 2026-09-01T00:40:34,765 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml' 2026-09-01T00:40:34,766 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml' 2026-09-01T00:40:34,768 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml' 2026-09-01T00:40:34,769 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml' 2026-09-01T00:40:34,770 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml' 2026-09-01T00:40:34,771 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml' 2026-09-01T00:40:34,772 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml' 2026-09-01T00:40:34,773 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml' 2026-09-01T00:40:34,774 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml' 2026-09-01T00:40:34,776 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml' 2026-09-01T00:40:34,777 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml' 2026-09-01T00:40:34,778 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml' 2026-09-01T00:40:34,779 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml' 2026-09-01T00:40:34,780 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml' 2026-09-01T00:40:34,781 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml' 2026-09-01T00:40:34,783 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml' 2026-09-01T00:40:34,784 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml' 2026-09-01T00:40:34,785 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml' 2026-09-01T00:40:34,786 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml' 2026-09-01T00:40:34,788 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml' 2026-09-01T00:40:34,789 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml' 2026-09-01T00:40:34,790 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml' 2026-09-01T00:40:34,791 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml' 2026-09-01T00:40:34,792 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml' 2026-09-01T00:40:34,794 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml' 2026-09-01T00:40:34,795 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml' 2026-09-01T00:40:34,796 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml' 2026-09-01T00:40:34,797 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml' 2026-09-01T00:40:34,798 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml' 2026-09-01T00:40:34,800 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml' 2026-09-01T00:40:34,801 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml' 2026-09-01T00:40:34,802 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml' 2026-09-01T00:40:34,803 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml' 2026-09-01T00:40:34,804 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml' 2026-09-01T00:40:34,805 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml' 2026-09-01T00:40:34,807 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml' 2026-09-01T00:40:34,808 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml' 2026-09-01T00:40:34,809 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml' 2026-09-01T00:40:34,810 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml' 2026-09-01T00:40:34,811 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml' 2026-09-01T00:40:34,812 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml' 2026-09-01T00:40:34,813 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml' 2026-09-01T00:40:34,815 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml' 2026-09-01T00:40:34,816 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml' 2026-09-01T00:40:34,817 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml' 2026-09-01T00:40:34,818 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml' 2026-09-01T00:40:34,819 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml' 2026-09-01T00:40:34,820 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml' 2026-09-01T00:40:34,821 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml' 2026-09-01T00:40:34,823 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml' 2026-09-01T00:40:34,824 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml' 2026-09-01T00:40:34,825 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml' 2026-09-01T00:40:34,826 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml' 2026-09-01T00:40:34,828 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml' 2026-09-01T00:40:34,829 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml' 2026-09-01T00:40:34,830 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml' 2026-09-01T00:40:34,831 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml' 2026-09-01T00:40:34,832 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml' 2026-09-01T00:40:34,834 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml' 2026-09-01T00:40:34,835 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml' 2026-09-01T00:40:34,836 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml' 2026-09-01T00:40:34,837 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml' 2026-09-01T00:40:34,838 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml' 2026-09-01T00:40:34,840 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml' 2026-09-01T00:40:34,841 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml' 2026-09-01T00:40:34,842 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml' 2026-09-01T00:40:34,843 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml' 2026-09-01T00:40:34,845 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml' 2026-09-01T00:40:34,846 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml' 2026-09-01T00:40:34,847 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml' 2026-09-01T00:40:34,848 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml' 2026-09-01T00:40:34,849 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml' 2026-09-01T00:40:34,850 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml' 2026-09-01T00:40:34,852 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml' 2026-09-01T00:40:34,853 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml' 2026-09-01T00:40:34,854 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml' 2026-09-01T00:40:34,855 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml' 2026-09-01T00:40:34,856 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml' 2026-09-01T00:40:34,857 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml' 2026-09-01T00:40:34,859 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml' 2026-09-01T00:40:34,860 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml' 2026-09-01T00:40:34,861 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml' 2026-09-01T00:40:34,862 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml' 2026-09-01T00:40:34,863 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml' 2026-09-01T00:40:34,864 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml' 2026-09-01T00:40:34,865 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml' 2026-09-01T00:40:34,867 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml' 2026-09-01T00:40:34,868 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml' 2026-09-01T00:40:34,869 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml' 2026-09-01T00:40:34,870 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml' 2026-09-01T00:40:34,871 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml' 2026-09-01T00:40:34,872 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml' 2026-09-01T00:40:34,874 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml' 2026-09-01T00:40:34,875 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml' 2026-09-01T00:40:34,876 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml' 2026-09-01T00:40:34,877 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml' 2026-09-01T00:40:34,878 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml' 2026-09-01T00:40:34,880 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml' 2026-09-01T00:40:34,881 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml' 2026-09-01T00:40:34,882 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml' 2026-09-01T00:40:34,883 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml' 2026-09-01T00:40:34,884 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml' 2026-09-01T00:40:34,886 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml' 2026-09-01T00:40:34,887 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml' 2026-09-01T00:40:34,888 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml' 2026-09-01T00:40:34,889 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml' 2026-09-01T00:40:34,890 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml' 2026-09-01T00:40:34,892 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml' 2026-09-01T00:40:34,893 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml' 2026-09-01T00:40:34,894 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml' 2026-09-01T00:40:34,895 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml' 2026-09-01T00:40:34,897 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml' 2026-09-01T00:40:34,898 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml' 2026-09-01T00:40:34,899 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml' 2026-09-01T00:40:34,900 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml' 2026-09-01T00:40:34,901 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml' 2026-09-01T00:40:34,902 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml' 2026-09-01T00:40:34,903 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml' 2026-09-01T00:40:34,904 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml' 2026-09-01T00:40:34,906 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml' 2026-09-01T00:40:34,907 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml' 2026-09-01T00:40:34,908 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml' 2026-09-01T00:40:34,909 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml' 2026-09-01T00:40:34,910 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml' 2026-09-01T00:40:34,911 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml' 2026-09-01T00:40:34,913 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml' 2026-09-01T00:40:34,914 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml' 2026-09-01T00:40:34,915 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml' 2026-09-01T00:40:34,916 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml' 2026-09-01T00:40:34,918 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml' 2026-09-01T00:40:34,919 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml' 2026-09-01T00:40:34,920 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml' 2026-09-01T00:40:34,921 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml' 2026-09-01T00:40:34,922 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml' 2026-09-01T00:40:34,924 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml' 2026-09-01T00:40:34,925 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml' 2026-09-01T00:40:34,926 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml' 2026-09-01T00:40:34,927 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml' 2026-09-01T00:40:34,928 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml' 2026-09-01T00:40:34,930 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml' 2026-09-01T00:40:34,931 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml' 2026-09-01T00:40:34,932 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml' 2026-09-01T00:40:34,933 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml' 2026-09-01T00:40:34,935 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml' 2026-09-01T00:40:34,936 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml' 2026-09-01T00:40:34,937 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml' 2026-09-01T00:40:34,938 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml' 2026-09-01T00:40:34,939 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml' 2026-09-01T00:40:34,941 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml' 2026-09-01T00:40:34,942 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml' 2026-09-01T00:40:34,943 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml' 2026-09-01T00:40:34,944 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml' 2026-09-01T00:40:34,945 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml' 2026-09-01T00:40:34,946 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml' 2026-09-01T00:40:34,947 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml' 2026-09-01T00:40:34,948 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml' 2026-09-01T00:40:34,950 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml' 2026-09-01T00:40:34,951 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml' 2026-09-01T00:40:34,952 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml' 2026-09-01T00:40:34,953 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml' 2026-09-01T00:40:34,954 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml' 2026-09-01T00:40:34,955 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml' 2026-09-01T00:40:34,956 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml' 2026-09-01T00:40:34,957 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml' 2026-09-01T00:40:34,959 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml' 2026-09-01T00:40:34,960 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml' 2026-09-01T00:40:34,961 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml' 2026-09-01T00:40:34,962 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml' 2026-09-01T00:40:34,963 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml' 2026-09-01T00:40:34,965 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml' 2026-09-01T00:40:34,966 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml' 2026-09-01T00:40:34,967 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml' 2026-09-01T00:40:34,968 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml' 2026-09-01T00:40:34,970 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml' 2026-09-01T00:40:34,971 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml' 2026-09-01T00:40:34,972 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml' 2026-09-01T00:40:34,973 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml' 2026-09-01T00:40:34,974 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml' 2026-09-01T00:40:34,976 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml' 2026-09-01T00:40:34,977 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml' 2026-09-01T00:40:34,978 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml' 2026-09-01T00:40:34,979 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml' 2026-09-01T00:40:34,981 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml' 2026-09-01T00:40:34,982 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml' 2026-09-01T00:40:34,983 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml' 2026-09-01T00:40:34,984 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml' 2026-09-01T00:40:34,985 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml' 2026-09-01T00:40:34,987 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml' 2026-09-01T00:40:34,988 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml' 2026-09-01T00:40:34,989 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml' 2026-09-01T00:40:34,990 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml' 2026-09-01T00:40:34,991 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml' 2026-09-01T00:40:34,992 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml' 2026-09-01T00:40:34,993 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml' 2026-09-01T00:40:34,994 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml' 2026-09-01T00:40:34,995 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml' 2026-09-01T00:40:34,996 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml' 2026-09-01T00:40:34,998 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml' 2026-09-01T00:40:34,999 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml' 2026-09-01T00:40:35,000 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml' 2026-09-01T00:40:35,001 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml' 2026-09-01T00:40:35,002 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml' 2026-09-01T00:40:35,003 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml' 2026-09-01T00:40:35,005 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml' 2026-09-01T00:40:35,006 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml' 2026-09-01T00:40:35,007 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml' 2026-09-01T00:40:35,008 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml' 2026-09-01T00:40:35,009 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml' 2026-09-01T00:40:35,010 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml' 2026-09-01T00:40:35,012 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml' 2026-09-01T00:40:35,013 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml' 2026-09-01T00:40:35,014 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml' 2026-09-01T00:40:35,015 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml' 2026-09-01T00:40:35,017 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml' 2026-09-01T00:40:35,018 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml' 2026-09-01T00:40:35,019 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml' 2026-09-01T00:40:35,020 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml' 2026-09-01T00:40:35,021 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml' 2026-09-01T00:40:35,023 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml' 2026-09-01T00:40:35,024 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml' 2026-09-01T00:40:35,025 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml' 2026-09-01T00:40:35,027 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml' 2026-09-01T00:40:35,028 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml' 2026-09-01T00:40:35,029 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml' 2026-09-01T00:40:35,030 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml' 2026-09-01T00:40:35,031 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml' 2026-09-01T00:40:35,033 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml' 2026-09-01T00:40:35,034 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml' 2026-09-01T00:40:35,035 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml' 2026-09-01T00:40:35,036 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml' 2026-09-01T00:40:35,037 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml' 2026-09-01T00:40:35,038 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml' 2026-09-01T00:40:35,039 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml' 2026-09-01T00:40:35,041 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml' 2026-09-01T00:40:35,042 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml' 2026-09-01T00:40:35,043 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml' 2026-09-01T00:40:35,044 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml' 2026-09-01T00:40:35,045 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml' 2026-09-01T00:40:35,047 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml' 2026-09-01T00:40:35,048 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml' 2026-09-01T00:40:35,049 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml' 2026-09-01T00:40:35,050 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml' 2026-09-01T00:40:35,051 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml' 2026-09-01T00:40:35,052 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml' 2026-09-01T00:40:35,054 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml' 2026-09-01T00:40:35,055 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml' 2026-09-01T00:40:35,056 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml' 2026-09-01T00:40:35,057 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml' 2026-09-01T00:40:35,058 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml' 2026-09-01T00:40:35,060 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml' 2026-09-01T00:40:35,061 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml' 2026-09-01T00:40:35,062 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml' 2026-09-01T00:40:35,063 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml' 2026-09-01T00:40:35,064 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml' 2026-09-01T00:40:35,066 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml' 2026-09-01T00:40:35,067 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml' 2026-09-01T00:40:35,068 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml' 2026-09-01T00:40:35,069 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml' 2026-09-01T00:40:35,070 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml' 2026-09-01T00:40:35,072 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml' 2026-09-01T00:40:35,073 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml' 2026-09-01T00:40:35,074 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml' 2026-09-01T00:40:35,075 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml' 2026-09-01T00:40:35,077 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml' 2026-09-01T00:40:35,078 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml' 2026-09-01T00:40:35,079 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml' 2026-09-01T00:40:35,080 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml' 2026-09-01T00:40:35,081 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml' 2026-09-01T00:40:35,082 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml' 2026-09-01T00:40:35,084 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml' 2026-09-01T00:40:35,085 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml' 2026-09-01T00:40:35,086 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml' 2026-09-01T00:40:35,087 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml' 2026-09-01T00:40:35,088 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml' 2026-09-01T00:40:35,090 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml' 2026-09-01T00:40:35,091 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml' 2026-09-01T00:40:35,092 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml' 2026-09-01T00:40:35,093 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml' 2026-09-01T00:40:35,094 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml' 2026-09-01T00:40:35,096 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml' 2026-09-01T00:40:35,097 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml' 2026-09-01T00:40:35,098 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml' 2026-09-01T00:40:35,099 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml' 2026-09-01T00:40:35,100 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml' 2026-09-01T00:40:35,102 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml' 2026-09-01T00:40:35,103 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml' 2026-09-01T00:40:35,104 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml' 2026-09-01T00:40:35,105 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml' 2026-09-01T00:40:35,106 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml' 2026-09-01T00:40:35,108 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml' 2026-09-01T00:40:35,109 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml' 2026-09-01T00:40:35,110 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml' 2026-09-01T00:40:35,111 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml' 2026-09-01T00:40:35,113 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml' 2026-09-01T00:40:35,116 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml' 2026-09-01T00:40:35,117 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml' 2026-09-01T00:40:35,118 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml' 2026-09-01T00:40:35,119 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml' 2026-09-01T00:40:35,121 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml' 2026-09-01T00:40:35,122 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml' 2026-09-01T00:40:35,123 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml' 2026-09-01T00:40:35,124 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml' 2026-09-01T00:40:35,126 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml' 2026-09-01T00:40:35,127 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml' 2026-09-01T00:40:35,128 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml' 2026-09-01T00:40:35,129 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml' 2026-09-01T00:40:35,130 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml' 2026-09-01T00:40:35,131 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml' 2026-09-01T00:40:35,132 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml' 2026-09-01T00:40:35,134 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml' 2026-09-01T00:40:35,135 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml' 2026-09-01T00:40:35,136 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml' 2026-09-01T00:40:35,137 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml' 2026-09-01T00:40:35,138 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml' 2026-09-01T00:40:35,140 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml' 2026-09-01T00:40:35,141 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml' 2026-09-01T00:40:35,142 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml' 2026-09-01T00:40:35,143 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml' 2026-09-01T00:40:35,144 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml' 2026-09-01T00:40:35,146 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml' 2026-09-01T00:40:35,147 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml' 2026-09-01T00:40:35,148 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml' 2026-09-01T00:40:35,149 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml' 2026-09-01T00:40:35,151 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml' 2026-09-01T00:40:35,152 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml' 2026-09-01T00:40:35,153 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml' 2026-09-01T00:40:35,154 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml' 2026-09-01T00:40:35,155 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml' 2026-09-01T00:40:35,157 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml' 2026-09-01T00:40:35,158 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml' 2026-09-01T00:40:35,159 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml' 2026-09-01T00:40:35,160 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml' 2026-09-01T00:40:35,162 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml' 2026-09-01T00:40:35,163 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml' 2026-09-01T00:40:35,164 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml' 2026-09-01T00:40:35,165 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml' 2026-09-01T00:40:35,166 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml' 2026-09-01T00:40:35,168 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml' 2026-09-01T00:40:35,169 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml' 2026-09-01T00:40:35,170 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml' 2026-09-01T00:40:35,171 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml' 2026-09-01T00:40:35,173 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml' 2026-09-01T00:40:35,174 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml' 2026-09-01T00:40:35,175 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml' 2026-09-01T00:40:35,176 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml' 2026-09-01T00:40:35,177 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml' 2026-09-01T00:40:35,178 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml' 2026-09-01T00:40:35,179 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml' 2026-09-01T00:40:35,181 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml' 2026-09-01T00:40:35,182 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml' 2026-09-01T00:40:35,183 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml' 2026-09-01T00:40:35,184 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml' 2026-09-01T00:40:35,186 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml' 2026-09-01T00:40:35,187 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml' 2026-09-01T00:40:35,188 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml' 2026-09-01T00:40:35,189 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml' 2026-09-01T00:40:35,190 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml' 2026-09-01T00:40:35,191 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml' 2026-09-01T00:40:35,193 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml' 2026-09-01T00:40:35,194 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml' 2026-09-01T00:40:35,195 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml' 2026-09-01T00:40:35,196 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml' 2026-09-01T00:40:35,197 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml' 2026-09-01T00:40:35,198 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml' 2026-09-01T00:40:35,200 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml' 2026-09-01T00:40:35,201 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml' 2026-09-01T00:40:35,202 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml' 2026-09-01T00:40:35,203 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml' 2026-09-01T00:40:35,205 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml' 2026-09-01T00:40:35,206 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml' 2026-09-01T00:40:35,207 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml' 2026-09-01T00:40:35,208 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml' 2026-09-01T00:40:35,210 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml' 2026-09-01T00:40:35,211 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml' 2026-09-01T00:40:35,212 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml' 2026-09-01T00:40:35,213 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml' 2026-09-01T00:40:35,214 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml' 2026-09-01T00:40:35,216 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml' 2026-09-01T00:40:35,217 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml' 2026-09-01T00:40:35,218 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml' 2026-09-01T00:40:35,219 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml' 2026-09-01T00:40:35,221 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml' 2026-09-01T00:40:35,222 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml' 2026-09-01T00:40:35,223 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml' 2026-09-01T00:40:35,224 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml' 2026-09-01T00:40:35,225 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml' 2026-09-01T00:40:35,226 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml' 2026-09-01T00:40:35,227 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml' 2026-09-01T00:40:35,229 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml' 2026-09-01T00:40:35,230 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml' 2026-09-01T00:40:35,231 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml' 2026-09-01T00:40:35,232 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml' 2026-09-01T00:40:35,234 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml' 2026-09-01T00:40:35,235 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml' 2026-09-01T00:40:35,236 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml' 2026-09-01T00:40:35,237 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml' 2026-09-01T00:40:35,238 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml' 2026-09-01T00:40:35,239 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml' 2026-09-01T00:40:35,241 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml' 2026-09-01T00:40:35,242 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml' 2026-09-01T00:40:35,243 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml' 2026-09-01T00:40:35,244 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml' 2026-09-01T00:40:35,246 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml' 2026-09-01T00:40:35,247 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml' 2026-09-01T00:40:35,248 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml' 2026-09-01T00:40:35,249 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml' 2026-09-01T00:40:35,250 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml' 2026-09-01T00:40:35,252 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml' 2026-09-01T00:40:35,253 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml' 2026-09-01T00:40:35,254 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml' 2026-09-01T00:40:35,255 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml' 2026-09-01T00:40:35,256 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml' 2026-09-01T00:40:35,258 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml' 2026-09-01T00:40:35,259 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml' 2026-09-01T00:40:35,260 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml' 2026-09-01T00:40:35,261 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml' 2026-09-01T00:40:35,262 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml' 2026-09-01T00:40:35,264 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml' 2026-09-01T00:40:35,265 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml' 2026-09-01T00:40:35,266 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml' 2026-09-01T00:40:35,267 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml' 2026-09-01T00:40:35,268 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml' 2026-09-01T00:40:35,269 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml' 2026-09-01T00:40:35,271 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml' 2026-09-01T00:40:35,272 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml' 2026-09-01T00:40:35,273 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml' 2026-09-01T00:40:35,274 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml' 2026-09-01T00:40:35,275 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml' 2026-09-01T00:40:35,276 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml' 2026-09-01T00:40:35,277 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml' 2026-09-01T00:40:35,279 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml' 2026-09-01T00:40:35,280 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml' 2026-09-01T00:40:35,281 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml' 2026-09-01T00:40:35,282 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml' 2026-09-01T00:40:35,283 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml' 2026-09-01T00:40:35,284 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml' 2026-09-01T00:40:35,286 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml' 2026-09-01T00:40:35,287 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml' 2026-09-01T00:40:35,288 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml' 2026-09-01T00:40:35,289 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml' 2026-09-01T00:40:35,291 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml' 2026-09-01T00:40:35,292 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml' 2026-09-01T00:40:35,293 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml' 2026-09-01T00:40:35,294 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml' 2026-09-01T00:40:35,295 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml' 2026-09-01T00:40:35,297 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml' 2026-09-01T00:40:35,298 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml' 2026-09-01T00:40:35,299 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml' 2026-09-01T00:40:35,300 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml' 2026-09-01T00:40:35,301 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml' 2026-09-01T00:40:35,302 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml' 2026-09-01T00:40:35,304 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml' 2026-09-01T00:40:35,305 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml' 2026-09-01T00:40:35,306 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml' 2026-09-01T00:40:35,308 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml' 2026-09-01T00:40:35,309 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml' 2026-09-01T00:40:35,310 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml' 2026-09-01T00:40:35,311 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml' 2026-09-01T00:40:35,312 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml' 2026-09-01T00:40:35,314 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml' 2026-09-01T00:40:35,315 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml' 2026-09-01T00:40:35,316 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml' 2026-09-01T00:40:35,317 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml' 2026-09-01T00:40:35,318 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml' 2026-09-01T00:40:35,319 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml' 2026-09-01T00:40:35,320 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml' 2026-09-01T00:40:35,322 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml' 2026-09-01T00:40:35,323 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml' 2026-09-01T00:40:35,324 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml' 2026-09-01T00:40:35,325 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml' 2026-09-01T00:40:35,326 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml' 2026-09-01T00:40:35,328 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml' 2026-09-01T00:40:35,329 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml' 2026-09-01T00:40:35,330 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml' 2026-09-01T00:40:35,331 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml' 2026-09-01T00:40:35,332 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml' 2026-09-01T00:40:35,334 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml' 2026-09-01T00:40:35,335 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml' 2026-09-01T00:40:35,336 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml' 2026-09-01T00:40:35,337 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml' 2026-09-01T00:40:35,338 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml' 2026-09-01T00:40:35,340 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml' 2026-09-01T00:40:35,341 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml' 2026-09-01T00:40:35,342 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml' 2026-09-01T00:40:35,343 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml' 2026-09-01T00:40:35,344 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml' 2026-09-01T00:40:35,346 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml' 2026-09-01T00:40:35,347 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml' 2026-09-01T00:40:35,348 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml' 2026-09-01T00:40:35,349 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml' 2026-09-01T00:40:35,350 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml' 2026-09-01T00:40:35,352 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml' 2026-09-01T00:40:35,353 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml' 2026-09-01T00:40:35,354 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml' 2026-09-01T00:40:35,355 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml' 2026-09-01T00:40:35,357 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml' 2026-09-01T00:40:35,358 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml' 2026-09-01T00:40:35,360 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml' 2026-09-01T00:40:35,361 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml' 2026-09-01T00:40:35,362 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml' 2026-09-01T00:40:35,363 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml' 2026-09-01T00:40:35,364 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml' 2026-09-01T00:40:35,366 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml' 2026-09-01T00:40:35,367 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml' 2026-09-01T00:40:35,368 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml' 2026-09-01T00:40:35,369 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml' 2026-09-01T00:40:35,370 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml' 2026-09-01T00:40:35,371 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml' 2026-09-01T00:40:35,373 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml' 2026-09-01T00:40:35,374 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml' 2026-09-01T00:40:35,375 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml' 2026-09-01T00:40:35,376 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml' 2026-09-01T00:40:35,377 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml' 2026-09-01T00:40:35,379 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml' 2026-09-01T00:40:35,380 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml' 2026-09-01T00:40:35,381 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml' 2026-09-01T00:40:35,382 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml' 2026-09-01T00:40:35,383 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml' 2026-09-01T00:40:35,385 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml' 2026-09-01T00:40:35,386 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml' 2026-09-01T00:40:35,387 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml' 2026-09-01T00:40:35,388 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml' 2026-09-01T00:40:35,390 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml' 2026-09-01T00:40:35,391 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml' 2026-09-01T00:40:35,392 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml' 2026-09-01T00:40:35,393 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml' 2026-09-01T00:40:35,395 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml' 2026-09-01T00:40:35,396 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml' 2026-09-01T00:40:35,397 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml' 2026-09-01T00:40:35,398 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml' 2026-09-01T00:40:35,400 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml' 2026-09-01T00:40:35,401 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml' 2026-09-01T00:40:35,402 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml' 2026-09-01T00:40:35,403 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml' 2026-09-01T00:40:35,405 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml' 2026-09-01T00:40:35,406 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml' 2026-09-01T00:40:35,407 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml' 2026-09-01T00:40:35,408 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml' 2026-09-01T00:40:35,409 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml' 2026-09-01T00:40:35,411 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml' 2026-09-01T00:40:35,412 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml' 2026-09-01T00:40:35,413 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml' 2026-09-01T00:40:35,414 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml' 2026-09-01T00:40:35,415 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml' 2026-09-01T00:40:35,416 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml' 2026-09-01T00:40:35,418 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml' 2026-09-01T00:40:35,419 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml' 2026-09-01T00:40:35,420 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml' 2026-09-01T00:40:35,421 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml' 2026-09-01T00:40:35,422 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml' 2026-09-01T00:40:35,424 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml' 2026-09-01T00:40:35,425 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml' 2026-09-01T00:40:35,426 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml' 2026-09-01T00:40:35,427 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml' 2026-09-01T00:40:35,428 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml' 2026-09-01T00:40:35,430 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml' 2026-09-01T00:40:35,431 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml' 2026-09-01T00:40:35,432 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml' 2026-09-01T00:40:35,433 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml' 2026-09-01T00:40:35,435 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml' 2026-09-01T00:40:35,436 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml' 2026-09-01T00:40:35,437 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml' 2026-09-01T00:40:35,439 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml' 2026-09-01T00:40:35,440 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml' 2026-09-01T00:40:35,441 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml' 2026-09-01T00:40:35,442 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml' 2026-09-01T00:40:35,443 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml' 2026-09-01T00:40:35,445 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml' 2026-09-01T00:40:35,446 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml' 2026-09-01T00:40:35,447 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml' 2026-09-01T00:40:35,448 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml' 2026-09-01T00:40:35,450 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml' 2026-09-01T00:40:35,451 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml' 2026-09-01T00:40:35,452 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml' 2026-09-01T00:40:35,453 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml' 2026-09-01T00:40:35,455 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml' 2026-09-01T00:40:35,456 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml' 2026-09-01T00:40:35,457 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml' 2026-09-01T00:40:35,458 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml' 2026-09-01T00:40:35,459 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml' 2026-09-01T00:40:35,460 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml' 2026-09-01T00:40:35,461 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml' 2026-09-01T00:40:35,463 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml' 2026-09-01T00:40:35,464 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml' 2026-09-01T00:40:35,465 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml' 2026-09-01T00:40:35,466 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml' 2026-09-01T00:40:35,467 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml' 2026-09-01T00:40:35,469 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml' 2026-09-01T00:40:35,470 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml' 2026-09-01T00:40:35,471 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml' 2026-09-01T00:40:35,472 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml' 2026-09-01T00:40:35,473 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml' 2026-09-01T00:40:35,474 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml' 2026-09-01T00:40:35,476 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml' 2026-09-01T00:40:35,477 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml' 2026-09-01T00:40:35,478 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml' 2026-09-01T00:40:35,479 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml' 2026-09-01T00:40:35,480 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml' 2026-09-01T00:40:35,482 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml' 2026-09-01T00:40:35,483 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml' 2026-09-01T00:40:35,484 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml' 2026-09-01T00:40:35,485 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml' 2026-09-01T00:40:35,487 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml' 2026-09-01T00:40:35,488 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml' 2026-09-01T00:40:35,489 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml' 2026-09-01T00:40:35,490 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml' 2026-09-01T00:40:35,492 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml' 2026-09-01T00:40:35,493 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml' 2026-09-01T00:40:35,494 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml' 2026-09-01T00:40:35,496 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml' 2026-09-01T00:40:35,497 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml' 2026-09-01T00:40:35,498 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml' 2026-09-01T00:40:35,499 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml' 2026-09-01T00:40:35,501 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml' 2026-09-01T00:40:35,502 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml' 2026-09-01T00:40:35,503 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml' 2026-09-01T00:40:35,504 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml' 2026-09-01T00:40:35,505 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml' 2026-09-01T00:40:35,507 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml' 2026-09-01T00:40:35,508 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml' 2026-09-01T00:40:35,509 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml' 2026-09-01T00:40:35,510 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml' 2026-09-01T00:40:35,511 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml' 2026-09-01T00:40:35,512 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml' 2026-09-01T00:40:35,514 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml' 2026-09-01T00:40:35,515 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml' 2026-09-01T00:40:35,516 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml' 2026-09-01T00:40:35,517 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml' 2026-09-01T00:40:35,518 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml' 2026-09-01T00:40:35,519 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml' 2026-09-01T00:40:35,521 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml' 2026-09-01T00:40:35,522 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml' 2026-09-01T00:40:35,523 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml' 2026-09-01T00:40:35,524 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml' 2026-09-01T00:40:35,526 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml' 2026-09-01T00:40:35,527 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml' 2026-09-01T00:40:35,528 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml' 2026-09-01T00:40:35,529 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml' 2026-09-01T00:40:35,530 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml' 2026-09-01T00:40:35,532 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml' 2026-09-01T00:40:35,533 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml' 2026-09-01T00:40:35,534 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml' 2026-09-01T00:40:35,535 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml' 2026-09-01T00:40:35,537 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml' 2026-09-01T00:40:35,538 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml' 2026-09-01T00:40:35,539 adding 'lm_eval/tasks/openai-mmmlu/default/utils.py' 2026-09-01T00:40:35,541 adding 'lm_eval/tasks/openbookqa/README.md' 2026-09-01T00:40:35,543 adding 'lm_eval/tasks/openbookqa/openbookqa.yaml' 2026-09-01T00:40:35,545 adding 'lm_eval/tasks/paloma/README.md' 2026-09-01T00:40:35,546 adding 'lm_eval/tasks/paloma/_paloma_template' 2026-09-01T00:40:35,547 adding 'lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml' 2026-09-01T00:40:35,548 adding 'lm_eval/tasks/paloma/paloma_c4_100_domains.yaml' 2026-09-01T00:40:35,549 adding 'lm_eval/tasks/paloma/paloma_c4_en.yaml' 2026-09-01T00:40:35,551 adding 'lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml' 2026-09-01T00:40:35,552 adding 'lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml' 2026-09-01T00:40:35,553 adding 'lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml' 2026-09-01T00:40:35,554 adding 'lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml' 2026-09-01T00:40:35,555 adding 'lm_eval/tasks/paloma/paloma_gab.yaml' 2026-09-01T00:40:35,556 adding 'lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml' 2026-09-01T00:40:35,558 adding 'lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml' 2026-09-01T00:40:35,559 adding 'lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml' 2026-09-01T00:40:35,560 adding 'lm_eval/tasks/paloma/paloma_mc4.yaml' 2026-09-01T00:40:35,561 adding 'lm_eval/tasks/paloma/paloma_ptb.yaml' 2026-09-01T00:40:35,562 adding 'lm_eval/tasks/paloma/paloma_redpajama.yaml' 2026-09-01T00:40:35,563 adding 'lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml' 2026-09-01T00:40:35,564 adding 'lm_eval/tasks/paloma/paloma_utils.py' 2026-09-01T00:40:35,565 adding 'lm_eval/tasks/paloma/paloma_wikitext_103.yaml' 2026-09-01T00:40:35,567 adding 'lm_eval/tasks/paws-x/README.md' 2026-09-01T00:40:35,568 adding 'lm_eval/tasks/paws-x/_generate_config.py' 2026-09-01T00:40:35,570 adding 'lm_eval/tasks/paws-x/_pawsx.yaml' 2026-09-01T00:40:35,571 adding 'lm_eval/tasks/paws-x/paws_de.yaml' 2026-09-01T00:40:35,572 adding 'lm_eval/tasks/paws-x/paws_en.yaml' 2026-09-01T00:40:35,573 adding 'lm_eval/tasks/paws-x/paws_es.yaml' 2026-09-01T00:40:35,574 adding 'lm_eval/tasks/paws-x/paws_fr.yaml' 2026-09-01T00:40:35,575 adding 'lm_eval/tasks/paws-x/paws_ja.yaml' 2026-09-01T00:40:35,576 adding 'lm_eval/tasks/paws-x/paws_ko.yaml' 2026-09-01T00:40:35,577 adding 'lm_eval/tasks/paws-x/paws_zh.yaml' 2026-09-01T00:40:35,579 adding 'lm_eval/tasks/paws-x/pawsx_template_yaml' 2026-09-01T00:40:35,580 adding 'lm_eval/tasks/paws-x/utils.py' 2026-09-01T00:40:35,582 adding 'lm_eval/tasks/physics_gre/README.md' 2026-09-01T00:40:35,583 adding 'lm_eval/tasks/physics_gre/_physics_gre_template_yaml' 2026-09-01T00:40:35,584 adding 'lm_eval/tasks/physics_gre/physics_gre.yaml' 2026-09-01T00:40:35,586 adding 'lm_eval/tasks/physics_gre/physics_gre_additional.yaml' 2026-09-01T00:40:35,587 adding 'lm_eval/tasks/physics_gre/physics_gre_all.yaml' 2026-09-01T00:40:35,588 adding 'lm_eval/tasks/physics_gre/utils.py' 2026-09-01T00:40:35,590 adding 'lm_eval/tasks/pile/README.md' 2026-09-01T00:40:35,591 adding 'lm_eval/tasks/pile/pile_arxiv.yaml' 2026-09-01T00:40:35,592 adding 'lm_eval/tasks/pile/pile_bookcorpus2.yaml' 2026-09-01T00:40:35,594 adding 'lm_eval/tasks/pile/pile_books3.yaml' 2026-09-01T00:40:35,595 adding 'lm_eval/tasks/pile/pile_dm-mathematics.yaml' 2026-09-01T00:40:35,596 adding 'lm_eval/tasks/pile/pile_enron.yaml' 2026-09-01T00:40:35,597 adding 'lm_eval/tasks/pile/pile_europarl.yaml' 2026-09-01T00:40:35,598 adding 'lm_eval/tasks/pile/pile_freelaw.yaml' 2026-09-01T00:40:35,599 adding 'lm_eval/tasks/pile/pile_github.yaml' 2026-09-01T00:40:35,601 adding 'lm_eval/tasks/pile/pile_gutenberg.yaml' 2026-09-01T00:40:35,602 adding 'lm_eval/tasks/pile/pile_hackernews.yaml' 2026-09-01T00:40:35,603 adding 'lm_eval/tasks/pile/pile_nih-exporter.yaml' 2026-09-01T00:40:35,604 adding 'lm_eval/tasks/pile/pile_opensubtitles.yaml' 2026-09-01T00:40:35,605 adding 'lm_eval/tasks/pile/pile_openwebtext2.yaml' 2026-09-01T00:40:35,606 adding 'lm_eval/tasks/pile/pile_philpapers.yaml' 2026-09-01T00:40:35,608 adding 'lm_eval/tasks/pile/pile_pile-cc.yaml' 2026-09-01T00:40:35,609 adding 'lm_eval/tasks/pile/pile_pubmed-abstracts.yaml' 2026-09-01T00:40:35,610 adding 'lm_eval/tasks/pile/pile_pubmed-central.yaml' 2026-09-01T00:40:35,611 adding 'lm_eval/tasks/pile/pile_stackexchange.yaml' 2026-09-01T00:40:35,612 adding 'lm_eval/tasks/pile/pile_ubuntu-irc.yaml' 2026-09-01T00:40:35,613 adding 'lm_eval/tasks/pile/pile_uspto.yaml' 2026-09-01T00:40:35,615 adding 'lm_eval/tasks/pile/pile_wikipedia.yaml' 2026-09-01T00:40:35,616 adding 'lm_eval/tasks/pile/pile_youtubesubtitles.yaml' 2026-09-01T00:40:35,618 adding 'lm_eval/tasks/pile_10k/README.md' 2026-09-01T00:40:35,619 adding 'lm_eval/tasks/pile_10k/pile_10k.yaml' 2026-09-01T00:40:35,621 adding 'lm_eval/tasks/piqa/README.md' 2026-09-01T00:40:35,622 adding 'lm_eval/tasks/piqa/piqa.yaml' 2026-09-01T00:40:35,624 adding 'lm_eval/tasks/pisa/README.md' 2026-09-01T00:40:35,625 adding 'lm_eval/tasks/pisa/_pisa.yaml' 2026-09-01T00:40:35,626 adding 'lm_eval/tasks/pisa/_pisa_llm_judged.yaml' 2026-09-01T00:40:35,627 adding 'lm_eval/tasks/pisa/_template_yaml' 2026-09-01T00:40:35,628 adding 'lm_eval/tasks/pisa/pisa_ch.yaml' 2026-09-01T00:40:35,629 adding 'lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml' 2026-09-01T00:40:35,630 adding 'lm_eval/tasks/pisa/pisa_de.yaml' 2026-09-01T00:40:35,631 adding 'lm_eval/tasks/pisa/pisa_de_llm_judged.yaml' 2026-09-01T00:40:35,632 adding 'lm_eval/tasks/pisa/pisa_en.yaml' 2026-09-01T00:40:35,633 adding 'lm_eval/tasks/pisa/pisa_en_llm_judged.yaml' 2026-09-01T00:40:35,634 adding 'lm_eval/tasks/pisa/pisa_es.yaml' 2026-09-01T00:40:35,636 adding 'lm_eval/tasks/pisa/pisa_es_llm_judged.yaml' 2026-09-01T00:40:35,637 adding 'lm_eval/tasks/pisa/pisa_fr.yaml' 2026-09-01T00:40:35,638 adding 'lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml' 2026-09-01T00:40:35,639 adding 'lm_eval/tasks/pisa/pisa_it.yaml' 2026-09-01T00:40:35,640 adding 'lm_eval/tasks/pisa/pisa_it_llm_judged.yaml' 2026-09-01T00:40:35,642 adding 'lm_eval/tasks/pisa/utils.py' 2026-09-01T00:40:35,644 adding 'lm_eval/tasks/polemo2/README.md' 2026-09-01T00:40:35,645 adding 'lm_eval/tasks/polemo2/polemo2_in.yaml' 2026-09-01T00:40:35,646 adding 'lm_eval/tasks/polemo2/polemo2_out.yaml' 2026-09-01T00:40:35,648 adding 'lm_eval/tasks/portuguese_bench/README.md' 2026-09-01T00:40:35,650 adding 'lm_eval/tasks/portuguese_bench/assin2_rte.yaml' 2026-09-01T00:40:35,651 adding 'lm_eval/tasks/portuguese_bench/assin2_sts.yaml' 2026-09-01T00:40:35,652 adding 'lm_eval/tasks/portuguese_bench/assin2_utils.py' 2026-09-01T00:40:35,653 adding 'lm_eval/tasks/portuguese_bench/assin_entailment.yaml' 2026-09-01T00:40:35,655 adding 'lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml' 2026-09-01T00:40:35,656 adding 'lm_eval/tasks/portuguese_bench/portuguese_bench.yaml' 2026-09-01T00:40:35,658 adding 'lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml' 2026-09-01T00:40:35,659 adding 'lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py' 2026-09-01T00:40:35,660 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml' 2026-09-01T00:40:35,662 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml' 2026-09-01T00:40:35,663 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml' 2026-09-01T00:40:35,664 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml' 2026-09-01T00:40:35,665 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml' 2026-09-01T00:40:35,666 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml' 2026-09-01T00:40:35,668 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml' 2026-09-01T00:40:35,669 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml' 2026-09-01T00:40:35,670 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml' 2026-09-01T00:40:35,671 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml' 2026-09-01T00:40:35,672 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml' 2026-09-01T00:40:35,674 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml' 2026-09-01T00:40:35,675 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml' 2026-09-01T00:40:35,676 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml' 2026-09-01T00:40:35,677 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml' 2026-09-01T00:40:35,679 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml' 2026-09-01T00:40:35,680 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml' 2026-09-01T00:40:35,682 adding 'lm_eval/tasks/prost/README.md' 2026-09-01T00:40:35,683 adding 'lm_eval/tasks/prost/corypaik_prost.yaml' 2026-09-01T00:40:35,685 adding 'lm_eval/tasks/pubmedqa/README.md' 2026-09-01T00:40:35,686 adding 'lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py' 2026-09-01T00:40:35,687 adding 'lm_eval/tasks/pubmedqa/pubmedqa.yaml' 2026-09-01T00:40:35,689 adding 'lm_eval/tasks/putnam_axiom/README.md' 2026-09-01T00:40:35,690 adding 'lm_eval/tasks/putnam_axiom/putnam_axiom.yaml' 2026-09-01T00:40:35,691 adding 'lm_eval/tasks/putnam_axiom/putnam_axiom_original.yaml' 2026-09-01T00:40:35,692 adding 'lm_eval/tasks/putnam_axiom/putnam_axiom_variations.yaml' 2026-09-01T00:40:35,694 adding 'lm_eval/tasks/putnam_axiom/putnam_axiom_variations_org.yaml' 2026-09-01T00:40:35,696 adding 'lm_eval/tasks/putnam_axiom/utils.py' 2026-09-01T00:40:35,698 adding 'lm_eval/tasks/qa4mre/README.md' 2026-09-01T00:40:35,699 adding 'lm_eval/tasks/qa4mre/preprocess_qa4mre.py' 2026-09-01T00:40:35,700 adding 'lm_eval/tasks/qa4mre/qa4mre_2011.yaml' 2026-09-01T00:40:35,701 adding 'lm_eval/tasks/qa4mre/qa4mre_2012.yaml' 2026-09-01T00:40:35,702 adding 'lm_eval/tasks/qa4mre/qa4mre_2013.yaml' 2026-09-01T00:40:35,704 adding 'lm_eval/tasks/qasper/README.md' 2026-09-01T00:40:35,705 adding 'lm_eval/tasks/qasper/bool.yaml' 2026-09-01T00:40:35,707 adding 'lm_eval/tasks/qasper/freeform.yaml' 2026-09-01T00:40:35,708 adding 'lm_eval/tasks/qasper/metrics.py' 2026-09-01T00:40:35,709 adding 'lm_eval/tasks/qasper/utils.py' 2026-09-01T00:40:35,711 adding 'lm_eval/tasks/race/README.md' 2026-09-01T00:40:35,712 adding 'lm_eval/tasks/race/preprocess_race.py' 2026-09-01T00:40:35,713 adding 'lm_eval/tasks/race/race.yaml' 2026-09-01T00:40:35,715 adding 'lm_eval/tasks/realtoxicityprompts/metric.py' 2026-09-01T00:40:35,716 adding 'lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml' 2026-09-01T00:40:35,718 adding 'lm_eval/tasks/ruler/README.md' 2026-09-01T00:40:35,720 adding 'lm_eval/tasks/ruler/common_utils.py' 2026-09-01T00:40:35,721 adding 'lm_eval/tasks/ruler/cwe.yaml' 2026-09-01T00:40:35,723 adding 'lm_eval/tasks/ruler/cwe_utils.py' 2026-09-01T00:40:35,724 adding 'lm_eval/tasks/ruler/essays.py' 2026-09-01T00:40:35,726 adding 'lm_eval/tasks/ruler/fwe.yaml' 2026-09-01T00:40:35,727 adding 'lm_eval/tasks/ruler/fwe_utils.py' 2026-09-01T00:40:35,728 adding 'lm_eval/tasks/ruler/niah_multikey_1.yaml' 2026-09-01T00:40:35,729 adding 'lm_eval/tasks/ruler/niah_multikey_2.yaml' 2026-09-01T00:40:35,731 adding 'lm_eval/tasks/ruler/niah_multikey_3.yaml' 2026-09-01T00:40:35,732 adding 'lm_eval/tasks/ruler/niah_multiquery.yaml' 2026-09-01T00:40:35,733 adding 'lm_eval/tasks/ruler/niah_multivalue.yaml' 2026-09-01T00:40:35,734 adding 'lm_eval/tasks/ruler/niah_single_1.yaml' 2026-09-01T00:40:35,735 adding 'lm_eval/tasks/ruler/niah_single_2.yaml' 2026-09-01T00:40:35,736 adding 'lm_eval/tasks/ruler/niah_single_3.yaml' 2026-09-01T00:40:35,738 adding 'lm_eval/tasks/ruler/niah_utils.py' 2026-09-01T00:40:35,740 adding 'lm_eval/tasks/ruler/prepare_niah.py' 2026-09-01T00:40:35,741 adding 'lm_eval/tasks/ruler/qa_hotpot.yaml' 2026-09-01T00:40:35,742 adding 'lm_eval/tasks/ruler/qa_squad.yaml' 2026-09-01T00:40:35,744 adding 'lm_eval/tasks/ruler/qa_utils.py' 2026-09-01T00:40:35,746 adding 'lm_eval/tasks/ruler/ruler.yaml' 2026-09-01T00:40:35,747 adding 'lm_eval/tasks/ruler/vt.yaml' 2026-09-01T00:40:35,749 adding 'lm_eval/tasks/ruler/vt_utils.py' 2026-09-01T00:40:35,751 adding 'lm_eval/tasks/sciq/README.md' 2026-09-01T00:40:35,752 adding 'lm_eval/tasks/sciq/sciq.yaml' 2026-09-01T00:40:35,755 adding 'lm_eval/tasks/score/NON_GREEDY.md' 2026-09-01T00:40:35,756 adding 'lm_eval/tasks/score/README.md' 2026-09-01T00:40:35,758 adding 'lm_eval/tasks/score/non_greedy.sh' 2026-09-01T00:40:35,760 adding 'lm_eval/tasks/score/non_greedy_summarizer.py' 2026-09-01T00:40:35,761 adding 'lm_eval/tasks/score/score_robustness.yaml' 2026-09-01T00:40:35,763 adding 'lm_eval/tasks/score/utils.py' 2026-09-01T00:40:35,765 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml' 2026-09-01T00:40:35,767 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml' 2026-09-01T00:40:35,768 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml' 2026-09-01T00:40:35,769 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml' 2026-09-01T00:40:35,770 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml' 2026-09-01T00:40:35,771 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml' 2026-09-01T00:40:35,773 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml' 2026-09-01T00:40:35,774 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml' 2026-09-01T00:40:35,775 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml' 2026-09-01T00:40:35,776 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml' 2026-09-01T00:40:35,778 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml' 2026-09-01T00:40:35,779 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml' 2026-09-01T00:40:35,780 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml' 2026-09-01T00:40:35,782 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml' 2026-09-01T00:40:35,783 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml' 2026-09-01T00:40:35,784 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml' 2026-09-01T00:40:35,786 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml' 2026-09-01T00:40:35,787 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml' 2026-09-01T00:40:35,788 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml' 2026-09-01T00:40:35,789 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml' 2026-09-01T00:40:35,791 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml' 2026-09-01T00:40:35,792 adding 'lm_eval/tasks/score/agi_eval/prompt_templates.json' 2026-09-01T00:40:35,793 adding 'lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml' 2026-09-01T00:40:35,794 adding 'lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml' 2026-09-01T00:40:35,796 adding 'lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml' 2026-09-01T00:40:35,797 adding 'lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml' 2026-09-01T00:40:35,799 adding 'lm_eval/tasks/score/agi_eval/utils_agieval.py' 2026-09-01T00:40:35,802 adding 'lm_eval/tasks/score/math/math_grader.py' 2026-09-01T00:40:35,804 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml' 2026-09-01T00:40:35,805 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml' 2026-09-01T00:40:35,807 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml' 2026-09-01T00:40:35,808 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml' 2026-09-01T00:40:35,809 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml' 2026-09-01T00:40:35,811 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml' 2026-09-01T00:40:35,812 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml' 2026-09-01T00:40:35,813 adding 'lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml' 2026-09-01T00:40:35,814 adding 'lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml' 2026-09-01T00:40:35,816 adding 'lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml' 2026-09-01T00:40:35,817 adding 'lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml' 2026-09-01T00:40:35,819 adding 'lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml' 2026-09-01T00:40:35,820 adding 'lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml' 2026-09-01T00:40:35,821 adding 'lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml' 2026-09-01T00:40:35,823 adding 'lm_eval/tasks/score/math/prompt_templates.json' 2026-09-01T00:40:35,824 adding 'lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml' 2026-09-01T00:40:35,825 adding 'lm_eval/tasks/score/math/score_prompt_robustness_math.yaml' 2026-09-01T00:40:35,826 adding 'lm_eval/tasks/score/math/score_robustness_math.yaml' 2026-09-01T00:40:35,828 adding 'lm_eval/tasks/score/math/to_be_fixed_questions.json' 2026-09-01T00:40:35,830 adding 'lm_eval/tasks/score/math/utils_math.py' 2026-09-01T00:40:35,832 adding 'lm_eval/tasks/score/mmlu_pro/prompt_templates.json' 2026-09-01T00:40:35,833 adding 'lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml' 2026-09-01T00:40:35,835 adding 'lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml' 2026-09-01T00:40:35,836 adding 'lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml' 2026-09-01T00:40:35,838 adding 'lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py' 2026-09-01T00:40:35,840 adding 'lm_eval/tasks/scrolls/README.md' 2026-09-01T00:40:35,841 adding 'lm_eval/tasks/scrolls/scrolls_contractnli.yaml' 2026-09-01T00:40:35,842 adding 'lm_eval/tasks/scrolls/scrolls_govreport.yaml' 2026-09-01T00:40:35,843 adding 'lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml' 2026-09-01T00:40:35,844 adding 'lm_eval/tasks/scrolls/scrolls_qasper.yaml' 2026-09-01T00:40:35,845 adding 'lm_eval/tasks/scrolls/scrolls_qmsum.yaml' 2026-09-01T00:40:35,846 adding 'lm_eval/tasks/scrolls/scrolls_quality.yaml' 2026-09-01T00:40:35,847 adding 'lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml' 2026-09-01T00:40:35,850 adding 'lm_eval/tasks/scrolls/task.py' 2026-09-01T00:40:35,852 adding 'lm_eval/tasks/simple_cooccurrence_bias/README.md' 2026-09-01T00:40:35,853 adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml' 2026-09-01T00:40:35,854 adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml' 2026-09-01T00:40:35,856 adding 'lm_eval/tasks/simple_cooccurrence_bias/utils.py' 2026-09-01T00:40:35,858 adding 'lm_eval/tasks/siqa/README.md' 2026-09-01T00:40:35,859 adding 'lm_eval/tasks/siqa/siqa.yaml' 2026-09-01T00:40:35,861 adding 'lm_eval/tasks/slr_bench/README.md' 2026-09-01T00:40:35,862 adding 'lm_eval/tasks/slr_bench/lm_eval_slr_bench.py' 2026-09-01T00:40:35,863 adding 'lm_eval/tasks/slr_bench/slr_bench_all.yaml' 2026-09-01T00:40:35,864 adding 'lm_eval/tasks/slr_bench/slr_bench_basic.yaml' 2026-09-01T00:40:35,866 adding 'lm_eval/tasks/slr_bench/slr_bench_common_yaml' 2026-09-01T00:40:35,867 adding 'lm_eval/tasks/slr_bench/slr_bench_easy.yaml' 2026-09-01T00:40:35,869 adding 'lm_eval/tasks/slr_bench/slr_bench_group.yaml' 2026-09-01T00:40:35,870 adding 'lm_eval/tasks/slr_bench/slr_bench_hard.yaml' 2026-09-01T00:40:35,871 adding 'lm_eval/tasks/slr_bench/slr_bench_medium.yaml' 2026-09-01T00:40:35,874 adding 'lm_eval/tasks/spanish_bench/README.md' 2026-09-01T00:40:35,875 adding 'lm_eval/tasks/spanish_bench/cocoteros_es.yaml' 2026-09-01T00:40:35,877 adding 'lm_eval/tasks/spanish_bench/copa_es.yaml' 2026-09-01T00:40:35,878 adding 'lm_eval/tasks/spanish_bench/escola.yaml' 2026-09-01T00:40:35,880 adding 'lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml' 2026-09-01T00:40:35,881 adding 'lm_eval/tasks/spanish_bench/openbookqa_es.yaml' 2026-09-01T00:40:35,882 adding 'lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml' 2026-09-01T00:40:35,884 adding 'lm_eval/tasks/spanish_bench/spanish_bench.yaml' 2026-09-01T00:40:35,886 adding 'lm_eval/tasks/spanish_bench/utils.py' 2026-09-01T00:40:35,887 adding 'lm_eval/tasks/spanish_bench/wnli_es.yaml' 2026-09-01T00:40:35,889 adding 'lm_eval/tasks/spanish_bench/xlsum_es.yaml' 2026-09-01T00:40:35,890 adding 'lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml' 2026-09-01T00:40:35,892 adding 'lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml' 2026-09-01T00:40:35,894 adding 'lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py' 2026-09-01T00:40:35,896 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml' 2026-09-01T00:40:35,898 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml' 2026-09-01T00:40:35,900 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml' 2026-09-01T00:40:35,901 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml' 2026-09-01T00:40:35,903 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml' 2026-09-01T00:40:35,904 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml' 2026-09-01T00:40:35,906 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml' 2026-09-01T00:40:35,907 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml' 2026-09-01T00:40:35,909 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml' 2026-09-01T00:40:35,910 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml' 2026-09-01T00:40:35,911 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml' 2026-09-01T00:40:35,913 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml' 2026-09-01T00:40:35,914 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml' 2026-09-01T00:40:35,916 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml' 2026-09-01T00:40:35,918 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml' 2026-09-01T00:40:35,919 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml' 2026-09-01T00:40:35,921 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml' 2026-09-01T00:40:35,923 adding 'lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common' 2026-09-01T00:40:35,924 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml' 2026-09-01T00:40:35,926 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml' 2026-09-01T00:40:35,928 adding 'lm_eval/tasks/squad_completion/README.md' 2026-09-01T00:40:35,930 adding 'lm_eval/tasks/squad_completion/squad_completion.yaml' 2026-09-01T00:40:35,932 adding 'lm_eval/tasks/squad_completion/task.py' 2026-09-01T00:40:35,934 adding 'lm_eval/tasks/squadv2/README.md' 2026-09-01T00:40:35,936 adding 'lm_eval/tasks/squadv2/squadv2.yaml' 2026-09-01T00:40:35,938 adding 'lm_eval/tasks/squadv2/task.py' 2026-09-01T00:40:35,940 adding 'lm_eval/tasks/storycloze/README.md' 2026-09-01T00:40:35,942 adding 'lm_eval/tasks/storycloze/storycloze_2016.yaml' 2026-09-01T00:40:35,943 adding 'lm_eval/tasks/storycloze/storycloze_2018.yaml' 2026-09-01T00:40:35,946 adding 'lm_eval/tasks/super_glue/README.md' 2026-09-01T00:40:35,948 adding 'lm_eval/tasks/super_glue/boolq/default.yaml' 2026-09-01T00:40:35,950 adding 'lm_eval/tasks/super_glue/boolq/seq2seq.yaml' 2026-09-01T00:40:35,951 adding 'lm_eval/tasks/super_glue/boolq/t5-prompt.yaml' 2026-09-01T00:40:35,953 adding 'lm_eval/tasks/super_glue/cb/aggregate.py' 2026-09-01T00:40:35,955 adding 'lm_eval/tasks/super_glue/cb/default.yaml' 2026-09-01T00:40:35,957 adding 'lm_eval/tasks/super_glue/cb/t5-prompt.yaml' 2026-09-01T00:40:35,958 adding 'lm_eval/tasks/super_glue/cb/t5_utils.py' 2026-09-01T00:40:35,960 adding 'lm_eval/tasks/super_glue/copa/default.yaml' 2026-09-01T00:40:35,962 adding 'lm_eval/tasks/super_glue/copa/t5-prompt.yaml' 2026-09-01T00:40:35,964 adding 'lm_eval/tasks/super_glue/copa/utils.py' 2026-09-01T00:40:35,966 adding 'lm_eval/tasks/super_glue/multirc/default.yaml' 2026-09-01T00:40:35,967 adding 'lm_eval/tasks/super_glue/multirc/t5-prompt.yaml' 2026-09-01T00:40:35,969 adding 'lm_eval/tasks/super_glue/multirc/t5_utils.py' 2026-09-01T00:40:35,971 adding 'lm_eval/tasks/super_glue/record/default.yaml' 2026-09-01T00:40:35,973 adding 'lm_eval/tasks/super_glue/record/t5-prompt.yaml' 2026-09-01T00:40:35,975 adding 'lm_eval/tasks/super_glue/record/t5_utils.py' 2026-09-01T00:40:35,977 adding 'lm_eval/tasks/super_glue/record/util.py' 2026-09-01T00:40:35,979 adding 'lm_eval/tasks/super_glue/rte/default.yaml' 2026-09-01T00:40:35,981 adding 'lm_eval/tasks/super_glue/rte/t5-prompt.yaml' 2026-09-01T00:40:35,983 adding 'lm_eval/tasks/super_glue/wic/default.yaml' 2026-09-01T00:40:35,984 adding 'lm_eval/tasks/super_glue/wic/t5-prompt.yaml' 2026-09-01T00:40:35,986 adding 'lm_eval/tasks/super_glue/wsc/default.yaml' 2026-09-01T00:40:35,988 adding 'lm_eval/tasks/super_glue/wsc/preprocess_wsc.py' 2026-09-01T00:40:35,989 adding 'lm_eval/tasks/super_glue/wsc/t5-prompt.yaml' 2026-09-01T00:40:35,990 adding 'lm_eval/tasks/super_glue/wsc/t5_utils.py' 2026-09-01T00:40:35,992 adding 'lm_eval/tasks/swag/README.md' 2026-09-01T00:40:35,993 adding 'lm_eval/tasks/swag/swag.yaml' 2026-09-01T00:40:35,995 adding 'lm_eval/tasks/swde/README.md' 2026-09-01T00:40:35,996 adding 'lm_eval/tasks/swde/swde.yaml' 2026-09-01T00:40:35,997 adding 'lm_eval/tasks/swde/task.py' 2026-09-01T00:40:36,000 adding 'lm_eval/tasks/tinyBenchmarks/README.md' 2026-09-01T00:40:36,001 adding 'lm_eval/tasks/tinyBenchmarks/agg_functions.py' 2026-09-01T00:40:36,002 adding 'lm_eval/tasks/tinyBenchmarks/tinyArc.yaml' 2026-09-01T00:40:36,003 adding 'lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml' 2026-09-01T00:40:36,004 adding 'lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml' 2026-09-01T00:40:36,006 adding 'lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml' 2026-09-01T00:40:36,007 adding 'lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml' 2026-09-01T00:40:36,008 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml' 2026-09-01T00:40:36,009 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml' 2026-09-01T00:40:36,010 adding 'lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml' 2026-09-01T00:40:36,012 adding 'lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py' 2026-09-01T00:40:36,013 adding 'lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py' 2026-09-01T00:40:36,014 adding 'lm_eval/tasks/tinyBenchmarks/utils_winogrande.py' 2026-09-01T00:40:36,016 adding 'lm_eval/tasks/tmlu/README.md' 2026-09-01T00:40:36,018 adding 'lm_eval/tasks/tmlu/subject.tsv' 2026-09-01T00:40:36,020 adding 'lm_eval/tasks/tmlu/default/_default_template_yaml' 2026-09-01T00:40:36,022 adding 'lm_eval/tasks/tmlu/default/_generate_configs.py' 2026-09-01T00:40:36,023 adding 'lm_eval/tasks/tmlu/default/_tmlu.yaml' 2026-09-01T00:40:36,025 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml' 2026-09-01T00:40:36,026 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml' 2026-09-01T00:40:36,027 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml' 2026-09-01T00:40:36,029 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml' 2026-09-01T00:40:36,030 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml' 2026-09-01T00:40:36,031 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml' 2026-09-01T00:40:36,032 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml' 2026-09-01T00:40:36,034 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml' 2026-09-01T00:40:36,035 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml' 2026-09-01T00:40:36,036 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml' 2026-09-01T00:40:36,037 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml' 2026-09-01T00:40:36,039 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml' 2026-09-01T00:40:36,040 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml' 2026-09-01T00:40:36,041 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml' 2026-09-01T00:40:36,042 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml' 2026-09-01T00:40:36,044 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml' 2026-09-01T00:40:36,045 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml' 2026-09-01T00:40:36,047 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml' 2026-09-01T00:40:36,048 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml' 2026-09-01T00:40:36,049 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml' 2026-09-01T00:40:36,050 adding 'lm_eval/tasks/tmlu/default/tmlu_accountant.yaml' 2026-09-01T00:40:36,052 adding 'lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml' 2026-09-01T00:40:36,053 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml' 2026-09-01T00:40:36,054 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml' 2026-09-01T00:40:36,055 adding 'lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml' 2026-09-01T00:40:36,056 adding 'lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml' 2026-09-01T00:40:36,057 adding 'lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml' 2026-09-01T00:40:36,059 adding 'lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml' 2026-09-01T00:40:36,060 adding 'lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml' 2026-09-01T00:40:36,061 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml' 2026-09-01T00:40:36,062 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml' 2026-09-01T00:40:36,063 adding 'lm_eval/tasks/tmlu/default/utils.py' 2026-09-01T00:40:36,065 adding 'lm_eval/tasks/tmmluplus/README.md' 2026-09-01T00:40:36,067 adding 'lm_eval/tasks/tmmluplus/subject.tsv' 2026-09-01T00:40:36,070 adding 'lm_eval/tasks/tmmluplus/default/_generate_configs.py' 2026-09-01T00:40:36,072 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml' 2026-09-01T00:40:36,073 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml' 2026-09-01T00:40:36,074 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml' 2026-09-01T00:40:36,075 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml' 2026-09-01T00:40:36,076 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml' 2026-09-01T00:40:36,077 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml' 2026-09-01T00:40:36,078 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml' 2026-09-01T00:40:36,080 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml' 2026-09-01T00:40:36,081 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml' 2026-09-01T00:40:36,082 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml' 2026-09-01T00:40:36,083 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml' 2026-09-01T00:40:36,084 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml' 2026-09-01T00:40:36,086 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml' 2026-09-01T00:40:36,087 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml' 2026-09-01T00:40:36,088 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml' 2026-09-01T00:40:36,089 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml' 2026-09-01T00:40:36,090 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml' 2026-09-01T00:40:36,091 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml' 2026-09-01T00:40:36,093 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml' 2026-09-01T00:40:36,094 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml' 2026-09-01T00:40:36,095 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml' 2026-09-01T00:40:36,096 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml' 2026-09-01T00:40:36,098 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml' 2026-09-01T00:40:36,099 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml' 2026-09-01T00:40:36,100 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml' 2026-09-01T00:40:36,101 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml' 2026-09-01T00:40:36,102 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml' 2026-09-01T00:40:36,104 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml' 2026-09-01T00:40:36,105 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml' 2026-09-01T00:40:36,106 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml' 2026-09-01T00:40:36,107 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml' 2026-09-01T00:40:36,109 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml' 2026-09-01T00:40:36,110 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml' 2026-09-01T00:40:36,111 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml' 2026-09-01T00:40:36,112 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml' 2026-09-01T00:40:36,113 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml' 2026-09-01T00:40:36,114 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml' 2026-09-01T00:40:36,115 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml' 2026-09-01T00:40:36,116 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml' 2026-09-01T00:40:36,118 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml' 2026-09-01T00:40:36,119 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml' 2026-09-01T00:40:36,120 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml' 2026-09-01T00:40:36,121 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml' 2026-09-01T00:40:36,122 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml' 2026-09-01T00:40:36,124 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml' 2026-09-01T00:40:36,125 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml' 2026-09-01T00:40:36,126 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml' 2026-09-01T00:40:36,127 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml' 2026-09-01T00:40:36,128 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml' 2026-09-01T00:40:36,130 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml' 2026-09-01T00:40:36,131 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml' 2026-09-01T00:40:36,132 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml' 2026-09-01T00:40:36,133 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml' 2026-09-01T00:40:36,134 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml' 2026-09-01T00:40:36,136 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml' 2026-09-01T00:40:36,137 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml' 2026-09-01T00:40:36,138 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml' 2026-09-01T00:40:36,139 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml' 2026-09-01T00:40:36,140 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml' 2026-09-01T00:40:36,142 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml' 2026-09-01T00:40:36,143 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml' 2026-09-01T00:40:36,144 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml' 2026-09-01T00:40:36,145 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml' 2026-09-01T00:40:36,146 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml' 2026-09-01T00:40:36,148 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml' 2026-09-01T00:40:36,149 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml' 2026-09-01T00:40:36,150 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml' 2026-09-01T00:40:36,151 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml' 2026-09-01T00:40:36,153 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml' 2026-09-01T00:40:36,154 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml' 2026-09-01T00:40:36,155 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml' 2026-09-01T00:40:36,156 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml' 2026-09-01T00:40:36,158 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml' 2026-09-01T00:40:36,159 adding 'lm_eval/tasks/tmmluplus/default/utils.py' 2026-09-01T00:40:36,161 adding 'lm_eval/tasks/toksuite/README.md' 2026-09-01T00:40:36,163 adding 'lm_eval/tasks/toksuite/_toksuite_abridged.yaml' 2026-09-01T00:40:36,164 adding 'lm_eval/tasks/toksuite/_toksuite_all.yaml' 2026-09-01T00:40:36,167 adding 'lm_eval/tasks/toksuite/utils.py' 2026-09-01T00:40:36,169 adding 'lm_eval/tasks/toksuite/toksuite_chinese/_toksuite_chinese.yaml' 2026-09-01T00:40:36,170 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_base.yaml' 2026-09-01T00:40:36,171 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_canonical.yaml' 2026-09-01T00:40:36,172 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_code_language_script_switching.yaml' 2026-09-01T00:40:36,173 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_colloquial.yaml' 2026-09-01T00:40:36,175 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_equivalent_expressions.yaml' 2026-09-01T00:40:36,176 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_keyboard_proximity_errors.yaml' 2026-09-01T00:40:36,177 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_ocr_errors.yaml' 2026-09-01T00:40:36,178 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_optional_diacritics.yaml' 2026-09-01T00:40:36,179 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_partially_romanized.yaml' 2026-09-01T00:40:36,181 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_romanization.yaml' 2026-09-01T00:40:36,182 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_space_removal.yaml' 2026-09-01T00:40:36,183 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_spelled_out.yaml' 2026-09-01T00:40:36,185 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_traditional.yaml' 2026-09-01T00:40:36,186 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_word_spacing_zero-width_characters_extra_space.yaml' 2026-09-01T00:40:36,189 adding 'lm_eval/tasks/toksuite/toksuite_english/_toksuite_english.yaml' 2026-09-01T00:40:36,190 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_abbreviations.yaml' 2026-09-01T00:40:36,191 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_base.yaml' 2026-09-01T00:40:36,192 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_canonical.yaml' 2026-09-01T00:40:36,194 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_capitalization.yaml' 2026-09-01T00:40:36,195 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_deletion.yaml' 2026-09-01T00:40:36,196 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_substitution.yaml' 2026-09-01T00:40:36,197 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_colloquial.yaml' 2026-09-01T00:40:36,198 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_compounds.yaml' 2026-09-01T00:40:36,200 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_contractions.yaml' 2026-09-01T00:40:36,201 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_date_formats.yaml' 2026-09-01T00:40:36,202 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_emoji_substitution.yaml' 2026-09-01T00:40:36,203 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_grammatical_errors.yaml' 2026-09-01T00:40:36,204 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_historical_spelling.yaml' 2026-09-01T00:40:36,206 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_homoglyphs.yaml' 2026-09-01T00:40:36,207 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_hyphenated_spelling.yaml' 2026-09-01T00:40:36,208 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_inflections.yaml' 2026-09-01T00:40:36,209 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_keyboard_proximity_errors.yaml' 2026-09-01T00:40:36,210 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_letter_repetition_for_emphasis.yaml' 2026-09-01T00:40:36,211 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_lowercase.yaml' 2026-09-01T00:40:36,213 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_macron_diacritic.yaml' 2026-09-01T00:40:36,214 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_ocr_errors.yaml' 2026-09-01T00:40:36,215 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_orthographic_errors.yaml' 2026-09-01T00:40:36,216 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_scripted_text.yaml' 2026-09-01T00:40:36,217 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_similar_words.yaml' 2026-09-01T00:40:36,218 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_space_removal.yaml' 2026-09-01T00:40:36,219 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spaced_styling.yaml' 2026-09-01T00:40:36,221 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spelled_out.yaml' 2026-09-01T00:40:36,222 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_superscript_subscript_styling.yaml' 2026-09-01T00:40:36,223 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_web_search_query.yaml' 2026-09-01T00:40:36,224 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_word_reordering.yaml' 2026-09-01T00:40:36,226 adding 'lm_eval/tasks/toksuite/toksuite_farsi/_toksuite_farsi.yaml' 2026-09-01T00:40:36,227 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_arabic_keyboard_for_farsi.yaml' 2026-09-01T00:40:36,228 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_base.yaml' 2026-09-01T00:40:36,230 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_canonical.yaml' 2026-09-01T00:40:36,231 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_code_language_script_switching.yaml' 2026-09-01T00:40:36,232 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_colloquial.yaml' 2026-09-01T00:40:36,233 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_dialects.yaml' 2026-09-01T00:40:36,234 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_equivalent_expressions.yaml' 2026-09-01T00:40:36,236 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_keyboard_proximity_errors.yaml' 2026-09-01T00:40:36,237 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_number_romanization.yaml' 2026-09-01T00:40:36,238 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_optional_diacritics.yaml' 2026-09-01T00:40:36,239 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_romanization.yaml' 2026-09-01T00:40:36,240 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_spelled_out.yaml' 2026-09-01T00:40:36,241 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_word_spacing_zero-width_characters_extra_space.yaml' 2026-09-01T00:40:36,243 adding 'lm_eval/tasks/toksuite/toksuite_italian/_toksuite_italian.yaml' 2026-09-01T00:40:36,245 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_abbreviations.yaml' 2026-09-01T00:40:36,246 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_base.yaml' 2026-09-01T00:40:36,247 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_canonical.yaml' 2026-09-01T00:40:36,248 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_capitalization.yaml' 2026-09-01T00:40:36,249 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_code_language_script_switching.yaml' 2026-09-01T00:40:36,251 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_contractions.yaml' 2026-09-01T00:40:36,252 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_date_formats.yaml' 2026-09-01T00:40:36,253 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_dialects.yaml' 2026-09-01T00:40:36,254 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_english_keyboard.yaml' 2026-09-01T00:40:36,255 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_grammatical_errors.yaml' 2026-09-01T00:40:36,257 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_keyboard_proximity_errors.yaml' 2026-09-01T00:40:36,258 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_numerical_formats.yaml' 2026-09-01T00:40:36,259 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_orthographic_errors.yaml' 2026-09-01T00:40:36,260 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_phonetic_spelling.yaml' 2026-09-01T00:40:36,261 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_plausible_diacritics_errors.yaml' 2026-09-01T00:40:36,262 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_similar_words.yaml' 2026-09-01T00:40:36,263 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_spelled_out.yaml' 2026-09-01T00:40:36,265 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_typographical_errors.yaml' 2026-09-01T00:40:36,266 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_web_search_query.yaml' 2026-09-01T00:40:36,268 adding 'lm_eval/tasks/toksuite/toksuite_math/_toksuite_math.yaml' 2026-09-01T00:40:36,269 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_base.yaml' 2026-09-01T00:40:36,270 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_canonical.yaml' 2026-09-01T00:40:36,271 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_chinese.yaml' 2026-09-01T00:40:36,272 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_decorative_unicode.yaml' 2026-09-01T00:40:36,273 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_farsi.yaml' 2026-09-01T00:40:36,275 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_italian.yaml' 2026-09-01T00:40:36,276 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_latex.yaml' 2026-09-01T00:40:36,277 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_space_removal.yaml' 2026-09-01T00:40:36,278 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_spelled_out.yaml' 2026-09-01T00:40:36,279 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_turkish.yaml' 2026-09-01T00:40:36,281 adding 'lm_eval/tasks/toksuite/toksuite_stem/_toksuite_stem.yaml' 2026-09-01T00:40:36,283 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_base.yaml' 2026-09-01T00:40:36,284 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_canonical.yaml' 2026-09-01T00:40:36,285 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_character_deletion.yaml' 2026-09-01T00:40:36,286 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_colloquial.yaml' 2026-09-01T00:40:36,288 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_diacriticized_styling.yaml' 2026-09-01T00:40:36,289 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_double_struck.yaml' 2026-09-01T00:40:36,290 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_enclosed_characters.yaml' 2026-09-01T00:40:36,291 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_equivalent_expressions.yaml' 2026-09-01T00:40:36,292 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_fullwidth_characters.yaml' 2026-09-01T00:40:36,294 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_latex.yaml' 2026-09-01T00:40:36,295 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_morpheme_separation.yaml' 2026-09-01T00:40:36,296 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_scripted_text.yaml' 2026-09-01T00:40:36,297 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_space_removal.yaml' 2026-09-01T00:40:36,298 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_spelled_out.yaml' 2026-09-01T00:40:36,300 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_strikethrough.yaml' 2026-09-01T00:40:36,301 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_superscript_subscript.yaml' 2026-09-01T00:40:36,302 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_typographical_errors.yaml' 2026-09-01T00:40:36,303 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unicode_formatting.yaml' 2026-09-01T00:40:36,304 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unusual_formatting.yaml' 2026-09-01T00:40:36,305 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_upside_down_rotated.yaml' 2026-09-01T00:40:36,307 adding 'lm_eval/tasks/toksuite/toksuite_turkish/_toksuite_turkish.yaml' 2026-09-01T00:40:36,308 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_base.yaml' 2026-09-01T00:40:36,310 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_canonical.yaml' 2026-09-01T00:40:36,311 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_code_language_script_switching.yaml' 2026-09-01T00:40:36,312 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_colloquial.yaml' 2026-09-01T00:40:36,313 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_date_formats.yaml' 2026-09-01T00:40:36,314 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_derivations.yaml' 2026-09-01T00:40:36,316 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_dialects.yaml' 2026-09-01T00:40:36,317 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_english_keyboard.yaml' 2026-09-01T00:40:36,318 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_equivalent_expressions.yaml' 2026-09-01T00:40:36,319 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_grammatical_errors.yaml' 2026-09-01T00:40:36,320 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_inflections.yaml' 2026-09-01T00:40:36,322 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_keyboard_proximity_errors.yaml' 2026-09-01T00:40:36,323 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_orthographic_errors.yaml' 2026-09-01T00:40:36,324 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_similar_words.yaml' 2026-09-01T00:40:36,325 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_spelled_out.yaml' 2026-09-01T00:40:36,327 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_typographical_errors.yaml' 2026-09-01T00:40:36,328 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_web_search_query.yaml' 2026-09-01T00:40:36,329 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_word_reordering.yaml' 2026-09-01T00:40:36,331 adding 'lm_eval/tasks/toxigen/README.md' 2026-09-01T00:40:36,332 adding 'lm_eval/tasks/toxigen/toxigen.yaml' 2026-09-01T00:40:36,333 adding 'lm_eval/tasks/toxigen/utils.py' 2026-09-01T00:40:36,335 adding 'lm_eval/tasks/translation/README.md' 2026-09-01T00:40:36,336 adding 'lm_eval/tasks/translation/iwslt2017_ar-en.yaml' 2026-09-01T00:40:36,338 adding 'lm_eval/tasks/translation/iwslt2017_en-ar.yaml' 2026-09-01T00:40:36,339 adding 'lm_eval/tasks/translation/utils.py' 2026-09-01T00:40:36,340 adding 'lm_eval/tasks/translation/wmt14_en-fr.yaml' 2026-09-01T00:40:36,342 adding 'lm_eval/tasks/translation/wmt14_fr-en.yaml' 2026-09-01T00:40:36,343 adding 'lm_eval/tasks/translation/wmt16_de-en.yaml' 2026-09-01T00:40:36,344 adding 'lm_eval/tasks/translation/wmt16_en-de.yaml' 2026-09-01T00:40:36,345 adding 'lm_eval/tasks/translation/wmt16_en-ro.yaml' 2026-09-01T00:40:36,347 adding 'lm_eval/tasks/translation/wmt16_ro-en.yaml' 2026-09-01T00:40:36,348 adding 'lm_eval/tasks/translation/wmt_common_yaml' 2026-09-01T00:40:36,350 adding 'lm_eval/tasks/triviaqa/README.md' 2026-09-01T00:40:36,351 adding 'lm_eval/tasks/triviaqa/default.yaml' 2026-09-01T00:40:36,353 adding 'lm_eval/tasks/truthfulqa/README.md' 2026-09-01T00:40:36,355 adding 'lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml' 2026-09-01T00:40:36,356 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml' 2026-09-01T00:40:36,357 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml' 2026-09-01T00:40:36,359 adding 'lm_eval/tasks/truthfulqa/utils.py' 2026-09-01T00:40:36,361 adding 'lm_eval/tasks/truthfulqa-multi/README.md' 2026-09-01T00:40:36,362 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml' 2026-09-01T00:40:36,363 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common' 2026-09-01T00:40:36,364 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml' 2026-09-01T00:40:36,365 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml' 2026-09-01T00:40:36,366 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml' 2026-09-01T00:40:36,367 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml' 2026-09-01T00:40:36,368 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml' 2026-09-01T00:40:36,369 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml' 2026-09-01T00:40:36,371 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml' 2026-09-01T00:40:36,372 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml' 2026-09-01T00:40:36,373 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml' 2026-09-01T00:40:36,374 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml' 2026-09-01T00:40:36,375 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml' 2026-09-01T00:40:36,376 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml' 2026-09-01T00:40:36,377 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml' 2026-09-01T00:40:36,379 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml' 2026-09-01T00:40:36,380 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common' 2026-09-01T00:40:36,382 adding 'lm_eval/tasks/truthfulqa-multi/utils.py' 2026-09-01T00:40:36,384 adding 'lm_eval/tasks/turblimp/README.md' 2026-09-01T00:40:36,385 adding 'lm_eval/tasks/turblimp/_template_yaml' 2026-09-01T00:40:36,386 adding 'lm_eval/tasks/turblimp/anaphor_agreement.yaml' 2026-09-01T00:40:36,388 adding 'lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml' 2026-09-01T00:40:36,389 adding 'lm_eval/tasks/turblimp/argument_structure_transitive.yaml' 2026-09-01T00:40:36,390 adding 'lm_eval/tasks/turblimp/binding.yaml' 2026-09-01T00:40:36,391 adding 'lm_eval/tasks/turblimp/determiners.yaml' 2026-09-01T00:40:36,392 adding 'lm_eval/tasks/turblimp/ellipsis.yaml' 2026-09-01T00:40:36,393 adding 'lm_eval/tasks/turblimp/irregular_forms.yaml' 2026-09-01T00:40:36,395 adding 'lm_eval/tasks/turblimp/island_effects.yaml' 2026-09-01T00:40:36,396 adding 'lm_eval/tasks/turblimp/nominalization.yaml' 2026-09-01T00:40:36,397 adding 'lm_eval/tasks/turblimp/npi_licensing.yaml' 2026-09-01T00:40:36,398 adding 'lm_eval/tasks/turblimp/passives.yaml' 2026-09-01T00:40:36,399 adding 'lm_eval/tasks/turblimp/quantifiers.yaml' 2026-09-01T00:40:36,401 adding 'lm_eval/tasks/turblimp/relative_clauses.yaml' 2026-09-01T00:40:36,402 adding 'lm_eval/tasks/turblimp/scrambling.yaml' 2026-09-01T00:40:36,403 adding 'lm_eval/tasks/turblimp/subject_agreement.yaml' 2026-09-01T00:40:36,404 adding 'lm_eval/tasks/turblimp/suspended_affixation.yaml' 2026-09-01T00:40:36,405 adding 'lm_eval/tasks/turblimp/turblimp_group.yaml' 2026-09-01T00:40:36,408 adding 'lm_eval/tasks/turkishmmlu/README.md' 2026-09-01T00:40:36,410 adding 'lm_eval/tasks/turkishmmlu/config/Biology.yaml' 2026-09-01T00:40:36,411 adding 'lm_eval/tasks/turkishmmlu/config/Chemistry.yaml' 2026-09-01T00:40:36,412 adding 'lm_eval/tasks/turkishmmlu/config/Geography.yaml' 2026-09-01T00:40:36,414 adding 'lm_eval/tasks/turkishmmlu/config/History.yaml' 2026-09-01T00:40:36,415 adding 'lm_eval/tasks/turkishmmlu/config/Mathematics.yaml' 2026-09-01T00:40:36,417 adding 'lm_eval/tasks/turkishmmlu/config/Philosophy.yaml' 2026-09-01T00:40:36,418 adding 'lm_eval/tasks/turkishmmlu/config/Physics.yaml' 2026-09-01T00:40:36,419 adding 'lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml' 2026-09-01T00:40:36,420 adding 'lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml' 2026-09-01T00:40:36,421 adding 'lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml' 2026-09-01T00:40:36,423 adding 'lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml' 2026-09-01T00:40:36,425 adding 'lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml' 2026-09-01T00:40:36,427 adding 'lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml' 2026-09-01T00:40:36,429 adding 'lm_eval/tasks/turkishmmlu/config_cot/History.yaml' 2026-09-01T00:40:36,430 adding 'lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml' 2026-09-01T00:40:36,432 adding 'lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml' 2026-09-01T00:40:36,434 adding 'lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml' 2026-09-01T00:40:36,435 adding 'lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml' 2026-09-01T00:40:36,437 adding 'lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml' 2026-09-01T00:40:36,438 adding 'lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml' 2026-09-01T00:40:36,440 adding 'lm_eval/tasks/tydiqa/README.md' 2026-09-01T00:40:36,441 adding 'lm_eval/tasks/tydiqa/_tydiqa_goldp_common_yaml' 2026-09-01T00:40:36,443 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_ar.yaml' 2026-09-01T00:40:36,444 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_bn.yaml' 2026-09-01T00:40:36,445 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_en.yaml' 2026-09-01T00:40:36,446 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_fi.yaml' 2026-09-01T00:40:36,447 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_id.yaml' 2026-09-01T00:40:36,449 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_ko.yaml' 2026-09-01T00:40:36,450 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_ru.yaml' 2026-09-01T00:40:36,451 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_sw.yaml' 2026-09-01T00:40:36,452 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_te.yaml' 2026-09-01T00:40:36,454 adding 'lm_eval/tasks/tydiqa/utils.py' 2026-09-01T00:40:36,456 adding 'lm_eval/tasks/ulqa/README.md' 2026-09-01T00:40:36,458 adding 'lm_eval/tasks/ulqa/celep1.yaml' 2026-09-01T00:40:36,459 adding 'lm_eval/tasks/ulqa/celep2.yaml' 2026-09-01T00:40:36,461 adding 'lm_eval/tasks/ulqa/lambada_uyghur.yaml' 2026-09-01T00:40:36,462 adding 'lm_eval/tasks/ulqa/uleval.yaml' 2026-09-01T00:40:36,463 adding 'lm_eval/tasks/ulqa/ulqa.yaml' 2026-09-01T00:40:36,465 adding 'lm_eval/tasks/ulqa/ulqa_.yaml' 2026-09-01T00:40:36,466 adding 'lm_eval/tasks/ulqa/ulut/nug.yaml' 2026-09-01T00:40:36,468 adding 'lm_eval/tasks/ulqa/ulut/ulut.yaml' 2026-09-01T00:40:36,469 adding 'lm_eval/tasks/ulqa/ulut/wag.yaml' 2026-09-01T00:40:36,470 adding 'lm_eval/tasks/ulqa/ulut/wsm.yaml' 2026-09-01T00:40:36,471 adding 'lm_eval/tasks/ulqa/ulut/wub.yaml' 2026-09-01T00:40:36,473 adding 'lm_eval/tasks/ulqa/ulut/wum.yaml' 2026-09-01T00:40:36,475 adding 'lm_eval/tasks/uncheatable_eval/README.md' 2026-09-01T00:40:36,476 adding 'lm_eval/tasks/uncheatable_eval/_uncheatable_eval_base.yaml' 2026-09-01T00:40:36,477 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval.yaml' 2026-09-01T00:40:36,479 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_english.yaml' 2026-09-01T00:40:36,480 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_nonenglish.yaml' 2026-09-01T00:40:36,481 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_cs.yaml' 2026-09-01T00:40:36,482 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_math.yaml' 2026-09-01T00:40:36,484 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_other.yaml' 2026-09-01T00:40:36,485 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_physics.yaml' 2026-09-01T00:40:36,486 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_bbc_news.yaml' 2026-09-01T00:40:36,487 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_biorxiv_all.yaml' 2026-09-01T00:40:36,489 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_cpp.yaml' 2026-09-01T00:40:36,490 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_javascript.yaml' 2026-09-01T00:40:36,491 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_markdown.yaml' 2026-09-01T00:40:36,492 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_other.yaml' 2026-09-01T00:40:36,493 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_python.yaml' 2026-09-01T00:40:36,494 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_utils.py' 2026-09-01T00:40:36,496 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_english.yaml' 2026-09-01T00:40:36,497 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_nonenglish.yaml' 2026-09-01T00:40:36,499 adding 'lm_eval/tasks/unitxt/20_newsgroups.yaml' 2026-09-01T00:40:36,500 adding 'lm_eval/tasks/unitxt/README.md' 2026-09-01T00:40:36,502 adding 'lm_eval/tasks/unitxt/ag_news.yaml' 2026-09-01T00:40:36,503 adding 'lm_eval/tasks/unitxt/argument_topic.yaml' 2026-09-01T00:40:36,504 adding 'lm_eval/tasks/unitxt/atis.yaml' 2026-09-01T00:40:36,505 adding 'lm_eval/tasks/unitxt/banking77.yaml' 2026-09-01T00:40:36,507 adding 'lm_eval/tasks/unitxt/claim_stance_topic.yaml' 2026-09-01T00:40:36,508 adding 'lm_eval/tasks/unitxt/cnn_dailymail.yaml' 2026-09-01T00:40:36,509 adding 'lm_eval/tasks/unitxt/coedit_gec.yaml' 2026-09-01T00:40:36,510 adding 'lm_eval/tasks/unitxt/dbpedia_14.yaml' 2026-09-01T00:40:36,511 adding 'lm_eval/tasks/unitxt/doc_vqa.yaml' 2026-09-01T00:40:36,512 adding 'lm_eval/tasks/unitxt/ethos_binary.yaml' 2026-09-01T00:40:36,513 adding 'lm_eval/tasks/unitxt/financial_tweets.yaml' 2026-09-01T00:40:36,514 adding 'lm_eval/tasks/unitxt/law_stack_exchange.yaml' 2026-09-01T00:40:36,515 adding 'lm_eval/tasks/unitxt/ledgar.yaml' 2026-09-01T00:40:36,517 adding 'lm_eval/tasks/unitxt/medical_abstracts.yaml' 2026-09-01T00:40:36,518 adding 'lm_eval/tasks/unitxt/stsb.yaml' 2026-09-01T00:40:36,519 adding 'lm_eval/tasks/unitxt/task.py' 2026-09-01T00:40:36,521 adding 'lm_eval/tasks/unitxt/unfair_tos.yaml' 2026-09-01T00:40:36,522 adding 'lm_eval/tasks/unitxt/unitxt' 2026-09-01T00:40:36,523 adding 'lm_eval/tasks/unitxt/unitxt_multimodal' 2026-09-01T00:40:36,524 adding 'lm_eval/tasks/unitxt/xsum.yaml' 2026-09-01T00:40:36,525 adding 'lm_eval/tasks/unitxt/yahoo_answers_topics.yaml' 2026-09-01T00:40:36,527 adding 'lm_eval/tasks/unscramble/README.md' 2026-09-01T00:40:36,529 adding 'lm_eval/tasks/unscramble/anagrams1.yaml' 2026-09-01T00:40:36,530 adding 'lm_eval/tasks/unscramble/anagrams2.yaml' 2026-09-01T00:40:36,531 adding 'lm_eval/tasks/unscramble/cycle_letters.yaml' 2026-09-01T00:40:36,532 adding 'lm_eval/tasks/unscramble/random_insertion.yaml' 2026-09-01T00:40:36,533 adding 'lm_eval/tasks/unscramble/reversed_words.yaml' 2026-09-01T00:40:36,535 adding 'lm_eval/tasks/webqs/README.md' 2026-09-01T00:40:36,537 adding 'lm_eval/tasks/webqs/utils.py' 2026-09-01T00:40:36,538 adding 'lm_eval/tasks/webqs/webqs.yaml' 2026-09-01T00:40:36,540 adding 'lm_eval/tasks/wikitext/README.md' 2026-09-01T00:40:36,541 adding 'lm_eval/tasks/wikitext/preprocess_wikitext.py' 2026-09-01T00:40:36,542 adding 'lm_eval/tasks/wikitext/wikitext.yaml' 2026-09-01T00:40:36,545 adding 'lm_eval/tasks/winogender/README.md' 2026-09-01T00:40:36,546 adding 'lm_eval/tasks/winogender/utils.py' 2026-09-01T00:40:36,547 adding 'lm_eval/tasks/winogender/winogender.yaml' 2026-09-01T00:40:36,548 adding 'lm_eval/tasks/winogender/winogender_female.yaml' 2026-09-01T00:40:36,549 adding 'lm_eval/tasks/winogender/winogender_gotcha.yaml' 2026-09-01T00:40:36,550 adding 'lm_eval/tasks/winogender/winogender_gotcha_female.yaml' 2026-09-01T00:40:36,552 adding 'lm_eval/tasks/winogender/winogender_gotcha_male.yaml' 2026-09-01T00:40:36,553 adding 'lm_eval/tasks/winogender/winogender_male.yaml' 2026-09-01T00:40:36,554 adding 'lm_eval/tasks/winogender/winogender_neutral.yaml' 2026-09-01T00:40:36,556 adding 'lm_eval/tasks/winogrande/README.md' 2026-09-01T00:40:36,557 adding 'lm_eval/tasks/winogrande/default.yaml' 2026-09-01T00:40:36,558 adding 'lm_eval/tasks/winogrande/preprocess_winogrande.py' 2026-09-01T00:40:36,560 adding 'lm_eval/tasks/wmdp/README.md' 2026-09-01T00:40:36,561 adding 'lm_eval/tasks/wmdp/_default_template_yaml' 2026-09-01T00:40:36,562 adding 'lm_eval/tasks/wmdp/_wmdp.yaml' 2026-09-01T00:40:36,563 adding 'lm_eval/tasks/wmdp/wmdp_bio.yaml' 2026-09-01T00:40:36,564 adding 'lm_eval/tasks/wmdp/wmdp_chem.yaml' 2026-09-01T00:40:36,566 adding 'lm_eval/tasks/wmdp/wmdp_cyber.yaml' 2026-09-01T00:40:36,568 adding 'lm_eval/tasks/wmt2016/README.md' 2026-09-01T00:40:36,569 adding 'lm_eval/tasks/wmt2016/metrics.py' 2026-09-01T00:40:36,570 adding 'lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml' 2026-09-01T00:40:36,572 adding 'lm_eval/tasks/wsc273/README.md' 2026-09-01T00:40:36,573 adding 'lm_eval/tasks/wsc273/default.yaml' 2026-09-01T00:40:36,574 adding 'lm_eval/tasks/wsc273/utils.py' 2026-09-01T00:40:36,576 adding 'lm_eval/tasks/xcopa/README.md' 2026-09-01T00:40:36,577 adding 'lm_eval/tasks/xcopa/_xcopa.yaml' 2026-09-01T00:40:36,578 adding 'lm_eval/tasks/xcopa/default_et.yaml' 2026-09-01T00:40:36,580 adding 'lm_eval/tasks/xcopa/default_ht.yaml' 2026-09-01T00:40:36,581 adding 'lm_eval/tasks/xcopa/default_id.yaml' 2026-09-01T00:40:36,582 adding 'lm_eval/tasks/xcopa/default_it.yaml' 2026-09-01T00:40:36,583 adding 'lm_eval/tasks/xcopa/default_qu.yaml' 2026-09-01T00:40:36,584 adding 'lm_eval/tasks/xcopa/default_sw.yaml' 2026-09-01T00:40:36,585 adding 'lm_eval/tasks/xcopa/default_ta.yaml' 2026-09-01T00:40:36,586 adding 'lm_eval/tasks/xcopa/default_th.yaml' 2026-09-01T00:40:36,587 adding 'lm_eval/tasks/xcopa/default_tr.yaml' 2026-09-01T00:40:36,588 adding 'lm_eval/tasks/xcopa/default_vi.yaml' 2026-09-01T00:40:36,589 adding 'lm_eval/tasks/xcopa/default_zh.yaml' 2026-09-01T00:40:36,591 adding 'lm_eval/tasks/xcopa/utils.py' 2026-09-01T00:40:36,593 adding 'lm_eval/tasks/xnli/README.md' 2026-09-01T00:40:36,594 adding 'lm_eval/tasks/xnli/_xnli.yaml' 2026-09-01T00:40:36,596 adding 'lm_eval/tasks/xnli/utils.py' 2026-09-01T00:40:36,597 adding 'lm_eval/tasks/xnli/xnli_ar.yaml' 2026-09-01T00:40:36,598 adding 'lm_eval/tasks/xnli/xnli_bg.yaml' 2026-09-01T00:40:36,599 adding 'lm_eval/tasks/xnli/xnli_common_yaml' 2026-09-01T00:40:36,600 adding 'lm_eval/tasks/xnli/xnli_de.yaml' 2026-09-01T00:40:36,602 adding 'lm_eval/tasks/xnli/xnli_el.yaml' 2026-09-01T00:40:36,603 adding 'lm_eval/tasks/xnli/xnli_en.yaml' 2026-09-01T00:40:36,604 adding 'lm_eval/tasks/xnli/xnli_es.yaml' 2026-09-01T00:40:36,605 adding 'lm_eval/tasks/xnli/xnli_fr.yaml' 2026-09-01T00:40:36,606 adding 'lm_eval/tasks/xnli/xnli_hi.yaml' 2026-09-01T00:40:36,607 adding 'lm_eval/tasks/xnli/xnli_ru.yaml' 2026-09-01T00:40:36,609 adding 'lm_eval/tasks/xnli/xnli_sw.yaml' 2026-09-01T00:40:36,610 adding 'lm_eval/tasks/xnli/xnli_th.yaml' 2026-09-01T00:40:36,611 adding 'lm_eval/tasks/xnli/xnli_tr.yaml' 2026-09-01T00:40:36,612 adding 'lm_eval/tasks/xnli/xnli_ur.yaml' 2026-09-01T00:40:36,613 adding 'lm_eval/tasks/xnli/xnli_vi.yaml' 2026-09-01T00:40:36,615 adding 'lm_eval/tasks/xnli/xnli_zh.yaml' 2026-09-01T00:40:36,617 adding 'lm_eval/tasks/xnli_eu/README.md' 2026-09-01T00:40:36,618 adding 'lm_eval/tasks/xnli_eu/xnli_common_yaml' 2026-09-01T00:40:36,619 adding 'lm_eval/tasks/xnli_eu/xnli_eu.yaml' 2026-09-01T00:40:36,620 adding 'lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml' 2026-09-01T00:40:36,622 adding 'lm_eval/tasks/xnli_eu/xnli_eu_native.yaml' 2026-09-01T00:40:36,624 adding 'lm_eval/tasks/xquad/README.md' 2026-09-01T00:40:36,625 adding 'lm_eval/tasks/xquad/utils.py' 2026-09-01T00:40:36,626 adding 'lm_eval/tasks/xquad/xquad_ar.yaml' 2026-09-01T00:40:36,627 adding 'lm_eval/tasks/xquad/xquad_common_yaml' 2026-09-01T00:40:36,628 adding 'lm_eval/tasks/xquad/xquad_de.yaml' 2026-09-01T00:40:36,630 adding 'lm_eval/tasks/xquad/xquad_el.yaml' 2026-09-01T00:40:36,631 adding 'lm_eval/tasks/xquad/xquad_en.yaml' 2026-09-01T00:40:36,632 adding 'lm_eval/tasks/xquad/xquad_es.yaml' 2026-09-01T00:40:36,633 adding 'lm_eval/tasks/xquad/xquad_hi.yaml' 2026-09-01T00:40:36,634 adding 'lm_eval/tasks/xquad/xquad_ro.yaml' 2026-09-01T00:40:36,635 adding 'lm_eval/tasks/xquad/xquad_ru.yaml' 2026-09-01T00:40:36,636 adding 'lm_eval/tasks/xquad/xquad_th.yaml' 2026-09-01T00:40:36,637 adding 'lm_eval/tasks/xquad/xquad_tr.yaml' 2026-09-01T00:40:36,639 adding 'lm_eval/tasks/xquad/xquad_vi.yaml' 2026-09-01T00:40:36,640 adding 'lm_eval/tasks/xquad/xquad_zh.yaml' 2026-09-01T00:40:36,642 adding 'lm_eval/tasks/xstorycloze/README.md' 2026-09-01T00:40:36,643 adding 'lm_eval/tasks/xstorycloze/_xstorycloze.yaml' 2026-09-01T00:40:36,644 adding 'lm_eval/tasks/xstorycloze/default_ar.yaml' 2026-09-01T00:40:36,645 adding 'lm_eval/tasks/xstorycloze/default_en.yaml' 2026-09-01T00:40:36,646 adding 'lm_eval/tasks/xstorycloze/default_es.yaml' 2026-09-01T00:40:36,647 adding 'lm_eval/tasks/xstorycloze/default_eu.yaml' 2026-09-01T00:40:36,648 adding 'lm_eval/tasks/xstorycloze/default_hi.yaml' 2026-09-01T00:40:36,649 adding 'lm_eval/tasks/xstorycloze/default_id.yaml' 2026-09-01T00:40:36,651 adding 'lm_eval/tasks/xstorycloze/default_my.yaml' 2026-09-01T00:40:36,652 adding 'lm_eval/tasks/xstorycloze/default_ru.yaml' 2026-09-01T00:40:36,653 adding 'lm_eval/tasks/xstorycloze/default_sw.yaml' 2026-09-01T00:40:36,654 adding 'lm_eval/tasks/xstorycloze/default_te.yaml' 2026-09-01T00:40:36,655 adding 'lm_eval/tasks/xstorycloze/default_zh.yaml' 2026-09-01T00:40:36,657 adding 'lm_eval/tasks/xwinograd/README.md' 2026-09-01T00:40:36,658 adding 'lm_eval/tasks/xwinograd/_xwinograd.yaml' 2026-09-01T00:40:36,660 adding 'lm_eval/tasks/xwinograd/utils.py' 2026-09-01T00:40:36,661 adding 'lm_eval/tasks/xwinograd/xwinograd_common_yaml' 2026-09-01T00:40:36,662 adding 'lm_eval/tasks/xwinograd/xwinograd_en.yaml' 2026-09-01T00:40:36,663 adding 'lm_eval/tasks/xwinograd/xwinograd_fr.yaml' 2026-09-01T00:40:36,664 adding 'lm_eval/tasks/xwinograd/xwinograd_jp.yaml' 2026-09-01T00:40:36,665 adding 'lm_eval/tasks/xwinograd/xwinograd_pt.yaml' 2026-09-01T00:40:36,667 adding 'lm_eval/tasks/xwinograd/xwinograd_ru.yaml' 2026-09-01T00:40:36,668 adding 'lm_eval/tasks/xwinograd/xwinograd_zh.yaml' 2026-09-01T00:40:36,672 adding 'lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml' 2026-09-01T00:40:36,673 adding 'lm_eval/tasks/zhoblimp/BA_deletion.yaml' 2026-09-01T00:40:36,674 adding 'lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml' 2026-09-01T00:40:36,675 adding 'lm_eval/tasks/zhoblimp/BA_inversion.yaml' 2026-09-01T00:40:36,676 adding 'lm_eval/tasks/zhoblimp/BA_meiba.yaml' 2026-09-01T00:40:36,678 adding 'lm_eval/tasks/zhoblimp/BA_negation.yaml' 2026-09-01T00:40:36,679 adding 'lm_eval/tasks/zhoblimp/BA_no_progressive.yaml' 2026-09-01T00:40:36,682 adding 'lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml' 2026-09-01T00:40:36,685 adding 'lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml' 2026-09-01T00:40:36,688 adding 'lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml' 2026-09-01T00:40:36,691 adding 'lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml' 2026-09-01T00:40:36,693 adding 'lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml' 2026-09-01T00:40:36,695 adding 'lm_eval/tasks/zhoblimp/BEI_construction_a.yaml' 2026-09-01T00:40:36,697 adding 'lm_eval/tasks/zhoblimp/BEI_construction_b.yaml' 2026-09-01T00:40:36,699 adding 'lm_eval/tasks/zhoblimp/BEI_deletion.yaml' 2026-09-01T00:40:36,700 adding 'lm_eval/tasks/zhoblimp/BEI_preposition.yaml' 2026-09-01T00:40:36,703 adding 'lm_eval/tasks/zhoblimp/PN_numP_a.yaml' 2026-09-01T00:40:36,705 adding 'lm_eval/tasks/zhoblimp/PN_numP_b.yaml' 2026-09-01T00:40:36,707 adding 'lm_eval/tasks/zhoblimp/README.md' 2026-09-01T00:40:36,708 adding 'lm_eval/tasks/zhoblimp/_template_yaml' 2026-09-01T00:40:36,709 adding 'lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml' 2026-09-01T00:40:36,711 adding 'lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml' 2026-09-01T00:40:36,712 adding 'lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml' 2026-09-01T00:40:36,713 adding 'lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml' 2026-09-01T00:40:36,714 adding 'lm_eval/tasks/zhoblimp/agent_causative.yaml' 2026-09-01T00:40:36,715 adding 'lm_eval/tasks/zhoblimp/agent_deletion.yaml' 2026-09-01T00:40:36,717 adding 'lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml' 2026-09-01T00:40:36,718 adding 'lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml' 2026-09-01T00:40:36,719 adding 'lm_eval/tasks/zhoblimp/causative_shi_ba.yaml' 2026-09-01T00:40:36,720 adding 'lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml' 2026-09-01T00:40:36,721 adding 'lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml' 2026-09-01T00:40:36,722 adding 'lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml' 2026-09-01T00:40:36,723 adding 'lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml' 2026-09-01T00:40:36,724 adding 'lm_eval/tasks/zhoblimp/ellipsis_adj.yaml' 2026-09-01T00:40:36,726 adding 'lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml' 2026-09-01T00:40:36,727 adding 'lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml' 2026-09-01T00:40:36,728 adding 'lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml' 2026-09-01T00:40:36,729 adding 'lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml' 2026-09-01T00:40:36,731 adding 'lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml' 2026-09-01T00:40:36,732 adding 'lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml' 2026-09-01T00:40:36,733 adding 'lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml' 2026-09-01T00:40:36,734 adding 'lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml' 2026-09-01T00:40:36,735 adding 'lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml' 2026-09-01T00:40:36,736 adding 'lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml' 2026-09-01T00:40:36,737 adding 'lm_eval/tasks/zhoblimp/left_adverbial_b.yaml' 2026-09-01T00:40:36,738 adding 'lm_eval/tasks/zhoblimp/left_adverbial_d.yaml' 2026-09-01T00:40:36,740 adding 'lm_eval/tasks/zhoblimp/left_adverbial_e.yaml' 2026-09-01T00:40:36,741 adding 'lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml' 2026-09-01T00:40:36,742 adding 'lm_eval/tasks/zhoblimp/left_dou.yaml' 2026-09-01T00:40:36,743 adding 'lm_eval/tasks/zhoblimp/modal_raising_hui.yaml' 2026-09-01T00:40:36,744 adding 'lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml' 2026-09-01T00:40:36,745 adding 'lm_eval/tasks/zhoblimp/nominal_definite_men.yaml' 2026-09-01T00:40:36,747 adding 'lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml' 2026-09-01T00:40:36,748 adding 'lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml' 2026-09-01T00:40:36,749 adding 'lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml' 2026-09-01T00:40:36,750 adding 'lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml' 2026-09-01T00:40:36,752 adding 'lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml' 2026-09-01T00:40:36,753 adding 'lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml' 2026-09-01T00:40:36,754 adding 'lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml' 2026-09-01T00:40:36,755 adding 'lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml' 2026-09-01T00:40:36,756 adding 'lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml' 2026-09-01T00:40:36,758 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml' 2026-09-01T00:40:36,759 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml' 2026-09-01T00:40:36,760 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml' 2026-09-01T00:40:36,761 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml' 2026-09-01T00:40:36,762 adding 'lm_eval/tasks/zhoblimp/passive_body_part.yaml' 2026-09-01T00:40:36,764 adding 'lm_eval/tasks/zhoblimp/passive_intransitive.yaml' 2026-09-01T00:40:36,765 adding 'lm_eval/tasks/zhoblimp/passive_no_adj.yaml' 2026-09-01T00:40:36,766 adding 'lm_eval/tasks/zhoblimp/passive_suo.yaml' 2026-09-01T00:40:36,767 adding 'lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml' 2026-09-01T00:40:36,768 adding 'lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml' 2026-09-01T00:40:36,770 adding 'lm_eval/tasks/zhoblimp/preposition_deletion.yaml' 2026-09-01T00:40:36,771 adding 'lm_eval/tasks/zhoblimp/preposition_insertion.yaml' 2026-09-01T00:40:36,772 adding 'lm_eval/tasks/zhoblimp/principle_A_c_command.yaml' 2026-09-01T00:40:36,773 adding 'lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml' 2026-09-01T00:40:36,774 adding 'lm_eval/tasks/zhoblimp/principle_A_domain.yaml' 2026-09-01T00:40:36,775 adding 'lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml' 2026-09-01T00:40:36,777 adding 'lm_eval/tasks/zhoblimp/question_A_not_A.yaml' 2026-09-01T00:40:36,778 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml' 2026-09-01T00:40:36,779 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml' 2026-09-01T00:40:36,780 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml' 2026-09-01T00:40:36,781 adding 'lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml' 2026-09-01T00:40:36,782 adding 'lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml' 2026-09-01T00:40:36,783 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml' 2026-09-01T00:40:36,785 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml' 2026-09-01T00:40:36,786 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml' 2026-09-01T00:40:36,787 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml' 2026-09-01T00:40:36,788 adding 'lm_eval/tasks/zhoblimp/question_daodi_negation.yaml' 2026-09-01T00:40:36,789 adding 'lm_eval/tasks/zhoblimp/question_nandao_negation.yaml' 2026-09-01T00:40:36,790 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml' 2026-09-01T00:40:36,792 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml' 2026-09-01T00:40:36,793 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml' 2026-09-01T00:40:36,794 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml' 2026-09-01T00:40:36,795 adding 'lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml' 2026-09-01T00:40:36,796 adding 'lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml' 2026-09-01T00:40:36,798 adding 'lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml' 2026-09-01T00:40:36,799 adding 'lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml' 2026-09-01T00:40:36,800 adding 'lm_eval/tasks/zhoblimp/question_particle_nandao.yaml' 2026-09-01T00:40:36,801 adding 'lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml' 2026-09-01T00:40:36,802 adding 'lm_eval/tasks/zhoblimp/relative_operator_who.yaml' 2026-09-01T00:40:36,804 adding 'lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml' 2026-09-01T00:40:36,805 adding 'lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml' 2026-09-01T00:40:36,806 adding 'lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml' 2026-09-01T00:40:36,807 adding 'lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml' 2026-09-01T00:40:36,808 adding 'lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml' 2026-09-01T00:40:36,809 adding 'lm_eval/tasks/zhoblimp/right_yijing_a.yaml' 2026-09-01T00:40:36,811 adding 'lm_eval/tasks/zhoblimp/right_yijing_b.yaml' 2026-09-01T00:40:36,812 adding 'lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml' 2026-09-01T00:40:36,813 adding 'lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml' 2026-09-01T00:40:36,814 adding 'lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml' 2026-09-01T00:40:36,815 adding 'lm_eval/tasks/zhoblimp/topicalization_OSV.yaml' 2026-09-01T00:40:36,816 adding 'lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml' 2026-09-01T00:40:36,818 adding 'lm_eval/tasks/zhoblimp/topicalization_SOV.yaml' 2026-09-01T00:40:36,819 adding 'lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml' 2026-09-01T00:40:36,820 adding 'lm_eval/tasks/zhoblimp/verb_negation_particle.yaml' 2026-09-01T00:40:36,821 adding 'lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml' 2026-09-01T00:40:36,822 adding 'lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml' 2026-09-01T00:40:36,823 adding 'lm_eval/tasks/zhoblimp/ya_insertion.yaml' 2026-09-01T00:40:36,825 adding 'lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml' 2026-09-01T00:40:36,826 adding 'lm_eval/tasks/zhoblimp/you_yige.yaml' 2026-09-01T00:40:36,827 adding 'lm_eval/tasks/zhoblimp/zhoblimp_group.yaml' 2026-09-01T00:40:36,830 adding 'lm_eval-0.4.13.dist-info/licenses/LICENSE.md' 2026-09-01T00:40:36,837 adding 'lm_eval-0.4.13.dist-info/METADATA' 2026-09-01T00:40:36,839 adding 'lm_eval-0.4.13.dist-info/WHEEL' 2026-09-01T00:40:36,840 adding 'lm_eval-0.4.13.dist-info/entry_points.txt' 2026-09-01T00:40:36,840 adding 'lm_eval-0.4.13.dist-info/top_level.txt' 2026-09-01T00:40:37,114 adding 'lm_eval-0.4.13.dist-info/RECORD' 2026-09-01T00:40:37,374 removing build/bdist.linux-armv7l/wheel 2026-09-01T00:40:41,709 Building wheel for lm-eval (pyproject.toml): finished with status 'done' 2026-09-01T00:40:41,917 Created wheel for lm-eval: filename=lm_eval-0.4.13-py3-none-any.whl size=9149387 sha256=7f7a7c9b6a4f414a211df8fb620291ab9d129d8f2440d47ea5be4adfdbcdaec1 2026-09-01T00:40:41,919 Stored in directory: /tmp/pip-ephem-wheel-cache-0ujak8fh/wheels/40/c5/1f/d2bc06b4952578f79a805a7eef4fef8368b030317007a215dc 2026-09-01T00:40:42,412 Successfully built lm-eval 2026-09-01T00:40:42,626 Removed build tracker: '/tmp/pip-build-tracker-af640hge'